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Preface 


The  purpose  of  this  study  was  to  design  an  environment  for  proper  software  reliability  model 
selection.  Previous  investigations  have  indicated  that  a  model  that  seems  to  be  the  best  for  one  set 
of  data  may  give  very  poor  results  with  another  set.  This  is  not  surprising  since  the  assumptions 
for  each  model  cannot  be  satisfied  in  all  situations,  due  to  variations  in  the  development  and  testing 
environments  for  each  project.  In  light  of  this  fact,  the  idea  behind  the  Proper  Model  Selection 
(PMS)  environment  was  to  liken  a  set  of  collected  data  to  other  known  sets  that  previously  proved  to 
fit  well  with  a  certain  software  reliability  model,  or  models.  Anyone  who  is  interested  in  determining 
a  proper  software  reliability  model  to  be  used  with  a  set  of  software  failure  data  should  find  this 
environment  to  be  useful. 

I  must  acknowledge  special  indebtedness  to  my  supervisor  Dr.  Panna  B.  Nagarsenker  for  the 
wise  counseling,  encouragement,  and  ongoing  support  which  made  this  work,  I  hope,  successful.  To 
Dr.  Brahmanand  N.  Nagarsenker,  I  pay  my  sincerest  thanks  for  his  vigorous  help  and  continuous 

support.  He  has  always  been  generous  and  encouraging.  I  am  also  deeply  indebted  to  Dr.  Henry 

/ 

Potoczny  for  the  continuous  help  throughout  the  courses  and  the  dissertation  research.  I  would  also 
like  to  thank  Dr.  Ben  Williams  for  his  enthusiasm,  support,  and  intelligent  remarks.  Gratitude  is 
also  due  to  Maj.  Woodruff  for  his  careful  reading  of  the  initial  draft  and  his  helpful  suggestions. 
Finally,  I  wish  to  express  my  appreciation  to  my  wife  for  her  patience  and  encouragement  throughout 
this  project. 
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Abstract 

An  environment  was  developed  for  solving  the  problem  of  selecting  a  proper  software  reliability 
model  for  a  given  set  of  software  failures.  The  idea  behind  the  environment  developed  in  this 
dissertation  W  is  to  liken  a  collected  set  of  software  failure  data  to  a  previous  one  that  proved  to 
fit  well  with  a  specified  software  reliability  model.  Software  failures  were  assumed  to  have  a  two 
Farameter  exponential  distribution  with  unequal  type  II  censoring.  A  test  critc.,on  was  derived 
for  testing  the  equality  of  software  failure  datasets  using  the  Maximum  Likelihood  Ratio  criterion. 
The  exact  distribution  of  the  test  criterion  was  derived.  An  cisymptotic  approximation  was  also 
obtained  and  was  found  to  be  very  close  to  the  exact  distribution  when  the  number  of  failures  were 
more  than  twenty.  Software  failure  data  available  from  “Data  and  Analysis  Center  for  Software 
(DACS)”  were  used  as  the  initial  group  of  software  failure  sets.  The  environment  was  then  applied, 
for  testing  the  equality  of  several  software  failure  sets. 
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DEVELOPMENT  OF  AN  ENVIRONMENT  EOR 
SOETWARE  RELIABILITY  MODEL  SELECTION 

I.  INTRODUCTION 

Software  embedded  in  microprocessors  has  been  intensively  relied  on  in  the  past  two  decades 

to  perform  more  complex  and  critical  tasks  than  ever  before.  Such  taisks  now  include  space  shuttle 

programs,  weapons  coordination,  nuclear  power  plant  control,  air  traffic  control,  power  distribution 

systems,  and  medical  support  systems.  Relying  on  software  to  perform  such  mission  and  life  critical 

tasks,  and  the  sharp  increase  of  software  cost  relative  to  that  of  hardware,  has  led  to  the  emergence 

of  software  reliability  field  as  an  important  research  area.  Some  progress  has  been  achieved  in  this 

field  through  modern  programming  techniques,  new  methods  of  testing  and  proof  of  correctness, 

and  the  adoption  of  fault-tolerant  softw’are  products.  Despite  the  w'hole  work  and  research  done,  a 

/ 

perfect  software  product  is  not  yet  guaranteed.  This  problem  will  not  be  solved  in  the  near  future 
due  to  the  following  reasons: 

1.  Software  is  created  by  error-prone  humans,  and  there  is  no  way  to  prevent  programmers  from 
making  mistakes, 

2.  Systems  are  becoming  more  complex.  This,  in  turn,  will  make  the  task  of  checking  all  the 
paths  in  a  software  code  a  very  difficult  task.  As  Dijkslra  [25:861]  states: 

As  long  as  there  were  no  machines.  Programming  was  no  problem  at  all;  when  we 
had  a  few  weak  computers,  Programming  became  a  mild  problem,  and  now  we  have 
gigantic  computers.  Programming  has  become  an  equally  gigantic  problem. 
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].I  Background 


Software  testing  is  an  important  phase  in  the  life  cycle  of  any  software  product.  This  im¬ 
portance  comes  from  the  fact  that  whatever  software  engineering  disciplines  have  been  applied  to 
produce  a  reliable  software,  the  majority  of  effort  and  major  development  costs  will  be  associated 
with  this  phcise  [92:2].  The  most  important  tool  in  this  phase  is  a  software  reliability  model.  Be¬ 
sides  measuring  reliability  of  the  software,  software  reliability  models  can  help  in  the  following  ways 
[68:21-22]: 

1.  Quantitatively  evaluating  new  software  engineering  disciplines  proposed  for  improving  the 
process  of  software  development, 

2.  Evaluating  the  development  status  during  the  test  phase  of  a  project.  A  reliability  measure, 
such  as  current  failure  intensity,  has  been  found  to  be  much  more  practical  than  other  tradi¬ 
tional  methods  such  as  the  intuition  of  the  designers  or  test  team,  percent  of  tests  completed, 
or  successful  completion  of  critical  functional  tests, 

/ 

3.  Monitoring  the  operational  performance  of  software,  and  controlling  the  addition  of  new 
features  and  design  changes  to  the  software, 

4.  Enriching  insight  into  the  software  product  and  the  software  development  process,  which 
helps  in  making  informed  decisions, 

5.  Application  of  software  reliability  models  is  also  useful  in  future  development  of  other  software 
systems,  due  to  the  experiences  gained  from  analyzing  the  results. 

Despite  all  of  the  above  benefits,  many  managers  abandon  the  idea  of  applying  software  reliability 
models  to  their  projects.  This  can  mainly  be  attributed  to  the  problem  of  finding  the  proper 
software  reliability  model  for  a  given  set  of  failure  data.  Reasons  are  given  in  the  next  section. 
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IS  The  Problem  of  Soflioare  RehabiUly  Model  Self  cl  ton 

A  large  number  (currently  about  100  [20:322])  of  software  reliability  models  have  been  devel¬ 
oped  within  the  last  two  decades.  This  is  suppo.sed  to  result  in  some  definitive  models  that  can  be 
recommended  to  potential  users.  Unfortunately,  this  is  not  the  case.  Among  all  existing  software 
reliability  models,  there  is  no  single  model  that  can  be  trusted  to  perform  well  in  all  situations. 
The  main  reasons  for  this  problem  are  [1:950], [56:172]: 

1.  Each  model  can  produce  a  very  different  answer  from  the  others,  when  applied  to  predict  the 
reliability  of  a  software  system.  Further,  a  model  that  seems  to  be  best  for  one  set  of  data 
may  give  very  poor  results  with  another  set.  This  is  not  surprising,  since  the  assumptions  for 
each  model  cannot  be  satisfied  in  all  situations,  due  to  variations  in  development  and  testing 
environments  for  each  project, 

2.  Even  for  the  same  project,  good  performance  of  a  model  for  a  given  period  of  time  does  not 
guarantee  the  same  level  of  prediction  for  a  later  period, 

/ 

3.  There  is  no  available  priori  method  for  deciding  which  model  is  the  most  suitable  for  a  given 
set  of  data, 

4.  Software  failure  data  reflect  the  quality  of  the  project  under  development.  Consequently,  many 
organizations  consider  these  data  to  be  classified.  This  makes  validation  and  refinement  of 
different  models  a  difficult  task,  due  to  the  shortage  of  published  failure  data. 

As  mentioned  before,  the  above  reasons,  as  well  as  time  and  cost  constraints,  have  made  many 
software  practitioners  avoid  incorporating  reliability  modeling  as  a  management  technique.  This 
situation  makes  it  necessary  to  devote  less  effort  in  developing  more  software  reliability  models, 
and  concentrate  on  finding  tools  for  selecting  the  proper  model  for  a  given  set  of  data.  This  will 
help  in  establishing  a  software  reliability  theory  similar  to  that  of  hardware.  This  dissertation  is 
part  of  this  effort. 
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1.3  General  Approach 


From  the  above  discussion,  it  is  clear  that  a  simple  and  objective  method  is  needed  to  select 
the  best  model  for  a  given  set  of  data.  Our  approach  for  solving  this  problem  is  to  use  the  same 
model  that  proved  to  be  the  best  for  an  equal  set  of  data  in  the  past.  The  main  advantage  of  this 
method  is  that  one  will  make  use  of  the  previous  analysis  made  when  different  models  were  applied 
with  different  sets  of  data,  and  of  different  techniques  used  to  measure  the  predictive  quality  of 
software  reliability  models,  with  respect  to  known  sets  of  data.  This  will  be  done  without  evaluating 
different  models,  comparing  them,  and  then  choosing  the  best  one.  This  method  can  simply  be 
stated  as  “matching  a  software  reliability  model  to  a  given  set  of  failure  data”.  This  method  will 
provide  a  strong  framework  and  a  useful  data  base  system  that  results  in  the  user  confidence  of  the 
reliability  calculations  he/she  makes. 

The  sequence  for  solving  the  problem  can  be  simplified  as  follows; 

1.  Initially,  the  failure  data  available  from  Data  and  Analysis  Center  for  Software  (DACS)  [64] 

/ 

will  be  used  as  a  reference,  because  most  of  the  research  done  in  the  past  has  used  them, 
either  for  data  analysis  or  for  introducing  a  model, 

2.  During  the  test  phase  of  a  software  product,  failure  data  will  be  collected.  A  proper  software 
reliability  model  will  be  needed.  To  achieve  this,  collected  data  will  be  compared  with  those 
of  DACS  to  find  an  equal  set  to  the  collected  one, 

3.  If  two  sets  of  data  are  found  to  be  equal,  it  is  recisonable  to  assume  that  the  same  model  used 
in  the  past  and  gave  good  results  with  one  set  will  do  the  same  with  an  equal  set.  The  logic 
behind  this  method  is  similar  to  that  of  Littlewood  [52:142]  w^hen  he  stated  that 

if  a  user  knows  that  the  past  predictions  emanating  from  a  model  have  been  in 
close  accord  with  actual  behavior  for  a  particular  data  set,  then  he/she  can  have 
confidence  in  future  predictions  for  the  same  data. 


In  this  research,  tlie  term  an  equal  will  replace  the  term  Ihc  same  which  verifies  Littlewood'.s 
prediction  that  at  some  future  time,  it  may  be  possible  to  match  a  software  reliability  model 
to  a  program  via  the  characteristics  of  that  program  [52:152]. 

4.  Any  new  set  of  data  that  proves  to  be  in  close  accord  with  a  certain  software  reliability  model 
in  the  future  will  be  added  to  the  initial  sets  available  from  DACS. 

1.4  Assumptwns 

1.  Knowing  that  almost  all  models  assume  that  no  failures  occur  at  time  t  =  0,  and  the  ex¬ 
ponential  distribution  is  the  most  acceptable  one  in  the  software  reliability  field  due  to  the 
randomness  of  test  [92:62],  will  make  us  assume  that  the  times  between  failures  have  a  two 
parameter  exponential  distribution.  Proper  tests  will  be  applied  to  make  sure  that  the  un¬ 
derlying  distribution  is  exponential, 

2.  Because  this  study  does  not  recommend  specific  software  reliability  models  or  present  new 
ones,  any  software  reliability  model  that  proved  to  be  in  close  accord/ with  actual  behavior 
for  a  particular  data  set  is  assumed  to  be  a  valid  model, 

3.  Since  the  data  available  from  DACS  will  be  used,  the  following  assumptions  will  also  be 
applicable  [64:3-4]: 

(a)  Data  are  assumed  to  be  actual  execution  time  (CPU  time)  or  running  clock  time  (elapsed 
time  from  start  to  end  of  program  execution  on  a  running  computer), 

(b)  Failures  occurring  before  correcting  the  responsible  fault  are  not  counted. 

1.5  Sequence  of  Preseniaiton 

History  of  software  reliability  models,  some  general  concepts,  and  classification  of  existing  soft¬ 
ware  reliability  models,  wit  h  a  brief  description  of  some  classical  models,  will  be  given  in  Chapter  2. 
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Previous  approaclies  to  tlie  [irotilein  of  software  reliability  inociel  selection  are  given  in  Chai>ter  .'1 
A  iiiatheinalical  background  i.s  given  in  Chapter  4.  Derivation  of  the  lest  statistic  necessary  for 
contparing  two  or  more  sots  c;if  software  failure  data  is  given  in  Chapter  5.  The  Asymptotic  approxi¬ 
mation  of  this  test  statistic  for  the  case  of  software  failure  data  sets  of  more  than  20  failures  is  given 
in  Chapter  6.  Chapter  7  describes  the  developed  environment,  and  how  to  use  it  for  comparing  a 
set  of  data  with  those  of  DACS  or  any  other  set  of  software  failure  data,  along  with  the  results  of 
application  on  some  sets  of  available  data.  Finally,  conclusions  and  recommendations  for  further 


research  are  given  in  Chapter  8, 


n.  SOFTWA  RE  RELIABILITY  MODELS 


Software  reliability  is  defined  as  the  probability  of  failure-free  operation  of  software  under  test 
for  a  specified  period  of  time  in  specified  environments  [68:15],  According  to  this  definition,  two 
identical  copies  of  the  same  software  may  be  different,  if  they  are  used  under  different  operational 
conditions.  A  software  reliability  model  is  the  most  appropriate  tool  for  measuring  the  reliability  of 
software  programs.  Over  the  last  twenty  years,  a  large  number  of  software  reliability  models  have 
been  proposed,  studied,  and  compared. 

In  this  chapter,  the  different  methods  for  classifying  software  reliability  models  are  presented 
and  some  existing  software  reliability  models  are  described.  Before  going  into  these  claissifications, 
the  history  of  software  reliability  and  some  general  concepts  will  be  presented.  This  will  make 
understanding  the  subject  much  easier. 

S.J  History  of  Software  Reliability 

The  history  of  software  reliability  can  be  found  in  many  sources  [24,  68,  82,  84,  92].  The 
most  updated  history  at  this  time  is  that  in  M.  Xie’s  book  [92.9-21],  which  can  be  summarized  as 
follows: 

S.I.l  Before  1970 

•  By  the  development  of  computer  systems  in  the  sixties,  software  reliability  problems  arose, 
but  the  dividing  line  between  software  reliability  and  hardware  reliability  was  not  clear, 

•  Although  there  were  not  many  articles  devoted  directly  to  software  reliability  in  this  period, 
it  can  be  considered  as  the  initial  stage  of  the  explosion  of  software  reliability  models  in 
following  periods, 

•  The  description  of  programming  errors  as  a  birth-death  process  was  introduced  by  Hudson  [.16] 
in  1967. 
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2.1.2  1970-1979 


•  Great  development  were  made  in  this  period,  and  many  software  reliability  models  were  intro¬ 
duced.  The  software  reliability  field  changed  direction  from  proof  of  correctness  to  stochastic 
modeling  of  the  failure  process  and  statistical  analysis  of  failure  data, 

•  A  major  change  in  the  history  of  software  reliability  models  took  place  in  1972  when  the 
Jelinski-Moranda  (JM)  model  [38]  and  the  Shooman  model  [83]  were  introduced, 

•  Mills  [59]  suggested  the  error  seeding  method  for  estimating  the  software  reliability  in  1972, 

•  Using  the  Bayesian  methodology  for  estimating  the  time  between  failures  was  introduced  by 
Littlewood  [55]  in  1973, 

•  The  assumption  that  the  software  failures  process  can  be  modeled  as  a  nonhomogeneous 
Poisson  process  was  introduced  by  Schneidewind  [80]  in  1975, 

•  Using  execution  time  instead  of  calendar  time  for  software  reliability  modeling  was  introduced 
by  Musa  [63]  in  1975, 

•  The  idea  of  using  software  reliability  for  deciding  when  to  slop  testing  and  software  release 
policies  was  introduced  by  Forman  and  Singpurwalla  [28]  in  1977, 

•  Goel  and  Okumoto  [31]  modeled  the  process  of  imperfect  debugging  in  1978, 

•  A  famous  model  was  introduced  by  Goel  and  Okumoto  (GO  Model)  [33]  in  1979.  Many  later 
models  using  the  nonhomogeneous  Poisson  process  were  either  generalizations  or  modifications 
of  this  model, 

>  This  interesting  period  ended  by  the  publication  of  real  software  failure  data  by  Musa  [64]. 

2.1.. 3  19S0  -  19S9 

•  In  this  period,  most  of  the  models  proposed  earlier  were  applied  to  real  data  and  their  draw¬ 
backs  were  identified  and  discu.ssed.  Many  other  new  models  were  also  introduced. 
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•  Musa's  failure  data  made  it  possible  for  many  researchers  to  overcome  the  difficulty  of  getting 
relevant  software  failure  data, 

•  Okuinoto  and  Goel  [77]  proposed  some  software  release  models  and  si  udied  optimum  release 
time,  considering  reliability  and  cost,  in  1980, 

•  Choosing  the  proper  model  among  different  software  reliability  models  has  attracted  attention, 
and  tools  for  comparing  different  models  have  been  widely  studied  [41,  42,  50,  66], 

•  Nonhomogeneous  Poisson  process  models  have  attracted  the  attention  of  many  software  en¬ 
gineers  and  researchers  [30,  76,  94], 

•  In  1984,  Musa  and  Okumoto  [67]  suggested  a  logarithmic  Poisson  model  based  on  the  execu¬ 
tion  time  theory, 

•  In  1987,  M.  Xie  [91]  modified  the  Jelinski-Moranda  (JM)  model  [38]  by  assuming  that  earlier 
detected  faults  contribute  more  to  the  total  failure  rate, 

•  In  1989,  Ohba  [75]  suggested  a  generalization  of  existing  software  reliability  models  by  con¬ 
sidering  the  possibility  of  imperfect  debugging, 

•  Many  other  software  reliability  models  were  introduced  in  this  period.  Most,  of  these  models 
are  briefly  described  in  the  above  mentioned  book  by  M.  Xie  (see  pages  13-19). 

2.1.^  1990  -  present 

•  By  the  end  of  the  eighties,  the  software  reliability  field  was  saturated  with  software  reliability 
models.  Attention  now  is  directed  to  other  related  problems  such  as  tools  for  model  selection, 
multiversion  programming,  and  software  fault  tolerance  modeling, 

•  hrocklehurst  et  al  [14]  presented  a  technique  called  model  recalibration  for  improving  relia¬ 
bility  predictions. 
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•  Many  researcliers  liave  deeply  studied  the  fault-tolerance  technique  to  increasf-  the  relialulity 
of  software  programs  [C.  8,  11], 

•  Khoshgoftaar  [-15]  presented  a  technique  for  pro[>er  software  reliability  model  selection  using 
the  Akaike  Information  Criterion.  This  technique  will  be  explained  later  in  detail.  Another 
method  for  proper  model  selection  based  on  check  of  limits  is  presented  by  Huang  Xizi  [93], 

•  The  reliability  modeling  of  N  version  programming  is  studied  by  Goseva-Popstojanova  and 
Grnarov  [34], 

S.5  Some  General  Concepts 

Because  software  reliability  is  a  recently-developed  research  field,  there  are  many  new  concepts 
introduced  in  the  existing  literature.  There  are  also  some  new  ambiguous  definitions,  which  need 
to  be  clarified. 

2.2.1  Software,  Hardware  &  System  Reliability:  The  increasing  use  of  digital  techniques  in 
system  design  led  to  the  manifestation  of  three  important  facts  [46]: 

1.  The  main  part  of  the  system  cost  is  due  to  the  cost  of  software  development  and  maintenance, 

2.  Increased  delays  in  system  development  and  production  are  primarily'  due  to  delay's  in  software 
development  schedules, 

3.  The  reduced  reliability  of  a  system  containing  software  is  mainly  due  to  unreliable  enibeded 
software,  where  errors  are  detected  after  the  system  has  been  put  into  use. 

These  facts  made  it  necessary  to  direct  more  research  effects  in  the  field  of  estimating  the  reliability 
of  systems  containing  software.  The  reliability  of  such  systems  is  a  combination  of  hardware, 
software,  and  probably  some  other  factors  as  shown  in  Figure  (2.1),  From  this  figure,  it  is  clear  that 
proper  tools  for  measuring  the  reliability  of  both  hardware  and  software  are  needed  for  determining 
the  reliability  of  systems  that  contain  software. 
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Hardware 


Mission 


Soft  ware 


Combined  Failure  Probability 


Figure  2.1.  Relationship  Between  Hardware  Software  Reliability  (McCall[58]) 


2-5 


Mail  used  hardware  lliousarids  of  years  ago  wlien  the  ancient  Egyptians  used  a  range  of 
simple  tools  to  build  tlieir  temples  and  piyramids  and  to  create  their  wonderful  paintitigs.  On  the 
contrary,  cotnputers  and  software  came  to  existence  only  in  this  century.  This  time  gap  between 
software  and  hardware  explains  why  there  has  been  more  research  and  knowledge  in  the  field  of 
hardware  reliability  than  in  that  of  software  reliability.  There  are  some  similarities  between  the 
two  fields.  These  similarities  include  defining  terms  in  the  same  way,  which  explains  why  they 
are  sometimes  combined  to  get  the  system  reliability  [68:6].  As  an  example,  the  hazard  rate  Z(t) 
for  a  software  program  {hardware  componenl  )  can  be  defined  as  the  conditional  probability  that 
an  error  (a  failure)  happens  in  the  interval  {i,t  +  At)  given  that  the  program  (component)  h2is 
not  failed  up  to  time  t.  On  the  other  hand,  differences  betw'een  software  and  hardware  include 
[24:84], [68:7], [92:7]: 


1.  Software  does  not  \^ar  out.  Rather  it  becomes  obsolete  when  the  environment  it  was  designed 
for  changes, 

2.  The  source  of  software  failures  is  design  faults,  while  the  principal  source  of  hardware  failures 
is  physical  deterioration. 


3.  Once  a  software  defect  is  properly  fixed,  it  is  fixed  forever,  which  is  not  true  for  hardware, 

4.  Manufacturing  can  affect  the  quality  of  hardware  products,  while  replication  in  software 
products  can  be  performed  to  very  high  standards  of  quality, 

5  Software  reliability  changes  mainly  during  the  development  phase,  while  that  of  hardware 
usually  occurs  either  in  the  burn-in  phase,  or  at  the  end  of  its  useful  life  phase, 

6.  Redundancy  methodology  has  no  meaning  in  software  reliability  and  cannot  be  considered 
as  a  tool  for  improving  reliability.  The  analogous  technique  in  software  reliability  can  be 
achieved  by  using  mult aversion  programming, 

7.  Hardware  can  be  repaired  by  spare  modules,  which  is  not  the  case  for  software, 
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)S.  Preventive  niaintenance  is  very  iinporlaiit  for  liardware,  while  it  lias  no  meaning  for  software. 


9.  The  hardware  reliability  field  has  a  well-establishe<i  inathenuitical  theory  but  the  software 
reliability  field  does  not. 

2.2.2  Faults  and  Failures: 

2.2.2.  J  Faults:  A  program  fault  (bug)  is  a  defect  in  the  program  that  causes  the 
program  to  fail  when  it  is  executed  under  particular  conditions.  A  fault  can  be  viewed  either  from 
an  absolute  point  of  view  or  an  operational  one.  From  the  absolute  point  of  view,  a  fault  is  an 
independent  entity  that  can  be  defined  without  reference  to  failure.  In  other  words,  it  is  a  defective, 
missing  or  extra  instruction  or  set  of  instructions.  From  the  operational  point  of  view,  the  relation 
between  faults  and  failures  is  one  to  one.  To  compromise  between  these  two  views,  Musa  [68:237] 
defined  the  fault  as  “a  defective,  missing,  or  extra  instruction  or  set  of  related  instructions  that 
causes  one  or  more  actual  or  potential  failure  types".  The  majority  of  faults  occur  during  the 
integration  phase,  mainly  due  to  the  lack  of  communication  between  the  personnel  involved  in  the 
software  project  (programmers,  testers,  debuggers,  ...  etc.).  Faults  can  al.so  be  in  the  function  of 
the  module  itself  as  a  whole,  or  internal  to  it  (violation  of  the  programming  language  rules,  logical 
faults.  ...etc.). 


2.2.2. 2  Failures:  A  program  failure  is  defined  as  a  departure  of  the  output  of  a  pro¬ 
gram  from  its  requirements.  Since  failures  occur  during  execution  of  the  program,  they  are  dynamic 
in  nature.  Failures  are  associated  wdth  time  through  the  following  relations: 

1.  Time  at  which  a  failure  took  place, 

2.  Time  interval  between  two  successive  failures, 

3.  Total  number  of  failures  occurring  up  to  a  given  time, 

4.  Total  number  of  failures  experienced  in  a  time  interval. 
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From  tile  software  reliability  point  ol  view,  failures  occurring  as  a  result  of  propagation  of  previous 
failures  are  not  counted.  Failures  are  said  to  be  of  the  same  type  if  they  occur  for  the  same  run 
type,  and  are  characterized  by  the  same  discrepancy,  or  are  due  to  the  same  iirograni  fault. 

‘J.2.3  Fault  St:e:  There  has  been  much  argument  about  whether  faults  have  at)  equal  effect 
on  the  overall  reliability  of  a  software  program.  Some  authors,  such  as  Littlewood  [51:316],  believe 
that  faults  do  not  all  have  the  same  effect  on  reliability.  They  believe  that  faults  discovered  in  the 
earlier  stages  of  testing  have  higher  probability  of  occurrence.  These  are  considered  “big”  faults, 
with  a  more  significant  effect  on  software  reliability  than  those  “small”  faults  inherent  in  parts  of 
the  program  that  are  rarely  executed.  Thus,  the  size  of  a  fault  is  formulated  according  to  its  rate 
of  manifestation. 

2.S.4  Operational  Profile:  The  execution  of  a  program  can  be  viewed  as  a  single  entity,  that 
can  last  for  months  or  even  years  for  real  time  systems.  However,  it  will  be  easier  from  the  softw’are 
reliability  point  of  view  if  the  program  execution  is  divided  into  runs. 

.\  run  is  defined  as  a  function  that  the  program  performs,  such  as  a  transaction  in  an  airline 
reservation  system,  or  a  particular  service  performed  by  the  operating  system  for  a  user.  A  set 
of  identical  runs  is  called  a  run  type.  During  the  test  phase,  the  term  test  case  is  used  instead  of 
the  term  run  type.  Test  cases  are  chosen  to  simulate  the  real  operating  environments,  in  order  to 
make  sure  that  the  requirements  of  the  customer  are  correctly  met.  To  achieve  this  exactly,  the 
tester  must  tie  knowledgeaide  of  all  the  possible  run  types  of  the  program,  and  the  probability  of 
occurrence  of  each,  which  is  called  the  Operational  Profile. 

The  operational  profih  is  an  extremely  useful  concept  in  software  testing.  However,  it  may 
not  always  be  practical  to  determine  the  full  operational  profile  because  of  the  large  number  of 
run  types  that  can  be  involved.  Thus,  it  is  usually  impossible  to  test  all  run  types  of  a  program. 


fherefore  program  failures  occur. 


Figure  2.2.  An  Imperfect  Debugging  Process  [75:240] 

2. a. 5  Imperfect  Dcbuggiug:  Most  software  reliability  models  assume  that  a  fault  is  com¬ 
pletely  removed  directly  after  it.s  detection,  and  that  no  new  faults  are  introduced  (s]>awned)  due 
to  the  corrective  action.  This  makes  software  models  mathematii'ally  simple,  but  on  the  other 
hand,  far  from  reality.  That  is  mainly  due  to  the  fact  that  “Almost  all  professional  programmers 
have  experienced  cases  where  they  fixed  one  error  to  create  another  one"  [75:239]. 

.A.n  example  of  an  imperfect  debugging  process  is  shown  in  Figure  2.2.  Assuming  that  the 
correction  action  is  perfect,  the  tiumbcr  of  faults  is  reduced  by  1,  while  the  number  will  stay  the 
same  or  may  increjise  in  case  of  imperfect  fixing.  If  the  probability  of  imperfect  debugging  is  a 
then  the  debugging  process  can  be  considered  as  a  Markovian  process  [75:240]. 
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2.3  Softicare  Keliahihiy  Model  Cla.'^.sification.'. 

Proper  classification  of  software  reliability  models  is  necessary  to  distinguish  these  models 
from  each  other,  and  to  help  in  proper  model  s<;lection.  The  large  number  of  existing  software 
reliability  models  makes  their  classification  a  difficult  task.  Before  going  into  some  classifications, 
it  is  useful  to  know  the  components  of  a  software  reliability  model. 

Usually  a  software  reliability  model  involves  tfiree  main  components  [1:951]: 

1.  A  conditional  probabilistic  model  specifying  the  joint  distribution  of  any  subset  of  random 
variables  Tj,  conditional  on  an  unknowm  parameter  a  (The  TIs  are  assumed  to  be  independent 
in  all  models  considered  in  this  chapter), 

2.  An  inference  procedure  for  the  value  of  the  unknown  parameter  a  when  the  actual  data  are 
obtained  (realization  of7]'s), 

3.  A  prediction  procedure,  which  combines  the  above  two  components  to  provide  predictions  for 

future  TIs.  , 

Each  model  has  its  own  assumptions  on  the  software  failure  detection  rale,  the  number  of  faults 
in  the  software,  and  the  condition  of  testing  environments.  Models  can  differ  also  according  to  the 
inference  procedure  and  the  prediction  procedure  used.  There  are  several  classification  systems  in 
the  literature  for  software  reliability  models.  Examples  of  these  systems  include: 

2.3.1  Classification  According  to  the  Model  Assuinpiions:  Depending  on  the  assumptions 
and  procedures  used  for  modeling,  M.  Xie  [92:23-29]  suggested  the  following  classification  system: 

2. 3.1. 1  Markov  Models:  For  a  software  program  under  test,  the  number  of  faults  re¬ 
moved  and  those  remaining  at  time  t  are  both  random  values.  To  explain  the  reason  for  this 
randomness,  consider  a  program  that  has  initially  N  number  of  faults.  A  fault  will  cause  a  failure  if 
the  program  is  executed  for  certain  input  stales.  Due  to  the  uncertainly  of  where  faults  are  located 
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and  the  random  choice  of  input  states,  failures  will  occur  randomly  with  time.  Even  when  a  fault 
is  discovered,  there  is  no  certainty  about  perfect  fixing  or  even  the  introduction  of  new  faults.  The 
Markov  concept  is  useful  in  modeling  this  raiidom  behavior.  A  model  is  considered  to  be  under  this 
clcLSS  if  its  failure-counting  process  is  essentially  a  Markovian  process.  Examples  of  these  models 
are  the  Jelinski-Moranda  Model  (JM)  [38]  and  the  Schick- VVolverton  Model  [81]. 

S.3.1.S  Nonhomogeneous  Poisson  Process  Models:  Nonhomogeneous  Poisson  process 
(NHPP)  modeling  is  widely  used  in  hardware  reliability  theory.  The  same  concept  is  also  used  for 
modeling  software  reliability  growth,  and  many  models  belong  to  this  class.  The  failure  intensity 
A(<)  for  this  class  of  models  is 

A(0  =  dn(l)/dt, 

where  ^i{t)  is  the  mean  value  function  for  the  number  of  detected  faults  N{t).  By  using  different 

forms  for  p(<),  different  NHPP  models  can  be  derived.  Examples  of  this  class  of  models  are  the 

/ 

Goel-Okumoto  Model  (GO)  [33]  and  the  Schneidewind  Model  [80]. 

2. 3. 1.3  Bayesian  Models:  As  mentioned  before,  at  the  second  phase  of  software  relia¬ 
bility  modeling,  an  inference  procedure  is  used.  The  classical  methods  used  in  most  of  the  software 
models  are  the  maximum  likelihood  estimation  method  and  the  least  square  method.  The  third 
method  is  the  Bayesian  analysis  method.  The  main  drawbacks  of  this  method  are  its  complexity 
and  difficulty  of  application.  The  basic  idea  of  the  method  is  to  identify  a  prior  distribution  for  the 
parameter  to  be  estimated  (which  is  the  key  difficulty  in  carrying  out  Bayesian  analysis).  A  poste¬ 
rior  distribution  is  then  obtained  by  multiplying  the  likelihood  function  (obtained  from  the  collected 
data)  and  the  prior  distribution.  A  model  is  classified  under  this  category  if  a  Bayesian  technique 
is  used  for  parameter  estimation.  Examples  of  these  models  are  the  Bayesian  Jelinski-Moranda 
Model  (BJ.M)  [.'13]  and  the  Littlewood-Verrall  Model  (LV)  [.55]. 
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“2.8.1.^  Sfaltslical  Data  Analysis  Models:  In  this  class  of  models,  collected  failure  data 
are  analyzed  using  standard  statistical  methods,  such  as  time  series  analysis  and  reg,re.ssion  analysis. 
Software  reliability  can  then  be  estimated  and  predicted  as  a  result  of  these  analyses.  E.xamples  of 
these  models  are  the  Crow  and  Singpurwalla  Model  [19]  and  the  Singpnrwalla  and  Soyer  Model  [85]. 

2.5.1.5  Software  Metrics  Models:  Software  metrics  include  software  size  metrics,  soft¬ 
ware  structure  metrics,  understandability  metrics,  etc.  These  metrics  are  used  for  predicting  the 
number  of  faults  in  a  software  program.  They  are  useful  in  earlier  stages  of  soft.ware  development. 
The  main  disadvantage  of  existing  software  metrics  models  is  that  they  predict  the  number  of  faults 
in  a  program,  which  is  not  related  to  its  reliability.  More  information  about  these  metrics  can  be 
found  in  the  papers  by  Bailey  and  Dingee  [7],  Cote  [16],  Davis  and-LeBlanc  [20],  and  Munson  and 
Khoshgoftaar  [62]. 

2. 3. 1.6  Fault  Seeding  Models:  The  basic  approach  in  this  class  of  models  is  to  “seed’'  a 

known  number  of  faults  in  a  program,  which  is  assumed  to  have  an  unknown  number  of  indigenous 

/ 

faults.  Further,  it  is  assumed  that  the  distribution  of  the  seeded  faults  is  the  same  as  that  of  the 
indigenous  ones.  The  program  is  then  tested,  and  the  observed  numbers  of  seeded  and  indigenous 
faults  are  used  to  estimate  the  fault  content  in  the  program  prior  to  seeding.  Consequently  program 
reliability  and  other  relevant  measures  can  be  estimated.  Examples  of  these  models  are  the  Mills 
hypergeometric  model  [59]  and  its  modification  by  Lipow'  [48]. 

Some  drawbacks  of  this  technique  include  [53:46]: 

1.  Increasing  the  load  of  testing  effort,  since  the  debugger  has  to  manage  both  original  and 
seeded  faults, 

2.  Seeding  faults  uniformly  in  all  paths  of  a  software  program  is  always  a  difficult,  if  not  an 
impossible  task. 
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3.  1  he  total  miinher  of  faults  in  a  program  can  not  be  considered  a  stand-alone  measure  of  the 
program's  reliability. 

1  lupui  Domain  Based  Models:  The  basic  approach  t  aken  in  t  his  class  of  models 
is  similar  to  that  of  fault  seeding  models.  Tlie  operational  profile  concept  is  used  to  generate  a 
set  of  test  cases  from  an  input  distribution,  which  is  assumed  to  be  a  representative  of  the  actual 
operational  profile  of  the  program.  Due  to  tlie  difficulty  of  obtaining  the  exact  operational  profile, 
the  input  domain  is  divided  into  a  set  of  equivalent  classes,  each  of  which  is  usually  fis.sociated  with 
a  program  path.  An  estimate  of  program  reliability  is  obtained  according  to  the  portion  of  test 
cases  that  cause  the  program  to  fail.  Examples  of  this  type  of  models  are  Brown  and  Lipow  [15] 
and  Nelson  [73]. 

2.3.2  Classification  According  to  the  Nature  of  Failure  Process:  Under  this  classification 
system,  Goel  [30]  classified  software  reliability  models  into  the  following  groups: 

2.3.2. 1  Times  Between  Failures  Models:  In  this  class  of  modds.  the  time  between 
failures  is  the  process  under  study.  The  times  between  failures  are  assumed  to  have  a  distribution 
whose  parameters  will  be  estimated  from  the  observed  values  of  these  times.  Estimates  of  software 
reliability,  mean  time  to  next  failure,...  etc.,  are  then  obtained  from  the  fitted  model. 

2. 3. 2. 2  Failure  Count  Models:  The  main  interest  in  this  class  of  models  is  the  number 
of  program  failures  in  sjiecified  time  intervals,  or  those  accumulated  by  a  given  time  t.  rather  than 
times  between  failures.  The  cumulative  number  of  failures  by  time  t,  N (t)  is  assumed  to  be  the 
outcome  of  a  random  process,  which  can  be  completely  specified  by  a  discrete  distribution  function 
like  Poisson  or  Binomial.  Parameters  of  the  models  can  be  estimated  from  the  observed  values  of 
failure  counts.  Again,  other  estimates  of  softw’are  reliability,  mean  time  to  next  failure,  ...  etc.,  can 
be  obtained  from  the  fitted  model. 
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S.a.S.S  Fault  Seedtnfi  Modf  Is:  As  described  before. 


2.S.2.i  Jnpvl  Doviaui  Based  Models:  As  described  before. 

2.3.3  Musa-Okum.oio  Classtficalioii:  Musa  and  Okumolo  [68:250-251],  developed  a  cleissifi- 
cation  scheme  in  terms  of  five  different  at  tributes: 

1.  Tunc  domam:  Calendar  time  or  execution  time, 

2.  Category:  The  total  number  of  failures  that  can  be  experienced  in  infinite  time  is  either  finite 
or  infinite, 

3.  Type:  The  distribution  of  tlie  total  number  of  failures  experienced  by  time  i  (Poisson.  Bino¬ 
mial,.,,,  etc., 

4.  Class:  (for  finite  category  only)  functional  form  of  the  failure  intensity  in  terms  of  time 
(exponential,  Weibull,  Gamma,  ...etc.), 

5.  family:  (for  infinite  failure  category  only)  functional  form  of  the  failure  intensity  in  terms  of 
the  expected  number  of  failures  experienced  (Geometric,  Inverse  linear,  ...  etc). 

This  cleissification  scheme  is  given  in  Tables  2.1  and  2.2.  Note  that  in  the  finite  category  table, 
class  C  indicates  a  distribution  that  does  not  have  a  common  name.  The  same  principle  applies  for 
the  infinite  category  table,  where  t.\  pes  T  indicate  distributions  that  do  not  have  common  names. 

2. 3. 4  Oilier  Classification  Schemes:  There  are  many  otlier  classification  schemes  that  can 
be  found  in  the  literature.  Examples  of  other  classifications  include: 

1.  According  to  Apf^licable  Phase 

Ramamoorthy  and  Bastani  [78]  classified  software  reliability  models  according  to  the  phase 
where  the  software  model  applies.  They  classified  software  reliability  models  as  follows: 
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Table  2.1,  Finite  Category  Models  [68:251] 


Class 

1  ype 

Poisson 

Binomial 

Other  Types 

Exponential 

Musa  [63] 

Moranda  [61] 
Sclineidewind  [80] 
Goel-Okumoto  [33] 

Jelinski-Moranda  [38] 

Shooinan[83] 

Goel-Okumoto  [31] 
Musa  [65] 

Keiller-Littlewood  [42] 

VVeibull 

Schick- VVolverton  [81] 

Wagoner  [89] 

Cl 

Schick- Wolverton  [82] 

Pareto 

Gamma 

Yamada-Ohba-Osaki  [9d] 

Table  2.2.  Infinite  Category  Models  [68:251] 


Family 

Type 

IT 

T'2 

T3 

Poisson 

Geometric 

Moranda 

[61] 

Musa-Okumoto 

[67] 

Inverse  Linear 

Littlewood-Verrall 

[55] 

Invcr.se  Polynomial 
2nd  degree 

Littlewood-Verall 

[55] 

Power 

Crow  [17] 
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(a)  Debugging  Phase  Models 


(b)  Validation  Pliase  Models, 

(c)  Operational  Pliase  Models, 

(d)  Maintenance  f’hase  Models. 

2.  According  to  Nature  of  Debugging  Strategy 

Bastani  and  Ramainoorthy  [10]  classified  software  reliability  models  according  to  the  nature 
of  debugging  process  as: 

(a)  Reliability  Growth  Models, 

(b)  Sampling  Models, 

(c)  Seeding  Models. 

r-'roni  the  above  discussion,  it  is  clear  that  most  of  the  classifications  are  very  .similar. 

2.4  Classical  Software  Reliability  Models 

As  mentioned  before,  about  100  software  reliability  models  have  been  developed  to  predict 
software  reliability.  In  this  section,  a  brief  description  of  the  most  famous  models  will  be  given. 
The  construction  of  many  other  models  is  based  on  the  ideas  illustrated  by  these  models. 

2.4-1  J elinski- M oranda  Model  (JM):  This  model  [38]  is  one  of  the  early  models  that  the 
reader  finds  in  nearly  all  literature  on  software  reliability  modeling.  It  can  be  considered  as  the 
basis  for  most  of  the  models  that  followed  it.  It  was  proposed  by  Jelinski  and  Moranda  in  1972, 
taking  into  consideration  the  following  assumptions: 
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1.  A  finite  number  of  faults  initially  exists  in  the  program. 


2.  Faults  are  independent,  and  each  has  the  same  probability  of  occurrence, 

3.  The  debugging  process  is  perfect,  and  takes  place  immediately  when  an  error  is  detected, 

4.  The  hazard  rate  decreases  by  an  amount  <p  after  discovery  and  correction  of  each  fault 
(see  Figure  2.3), 

5.  The  lime  to  next  failure  is  proportional  to  the  number  of  remaining  faults  in  the  program. 


Figure  2.3.  Z(t)  Plot  for  JM  model  [38] 


Using  the  above  assumptions,  the  hazard  rate  between  the  (t  —  1)—  and  the  i— failure 

is  given  by 


Z{U)  =  <1>[N  -  (i  -  1}] 


(2.1) 


where 

ti  =  the  time  between  the  (f  —  1)—  and  the  failure 

d>  =  the  drop  in  the  hazard  rate  due  to  one  fault  removal 

:V  =  the  initial  number  of  faults  in  the  program 
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Now,  let  Ti.T-j.  ■  ■■ ,  7„  represcni  t  ii<-  t  inie  intervals  between  successive  failures.  Under  the  assump¬ 
tion  of  uniform  failure  rate  (which  unifies  that  the  times  between  failures  are  exponential  with  rate 
Z(t,)  ),  the  probability-  density  function  of  7’,  =  (/,  -  U-i)  is  given  by 

f{T,)  =  <i[A-  -  -  l)]exp{-<^[A^  -  (f  -  1)]7;}  (2.2) 


2.^.2  Bayesian  J  dm  ski- Moran  da  Model  (BJM):  The  motivation  for  the  introduction  of  this 
model  by  Litticwood  and  Sofer  [.53]  wa.s  that  the  JM  model  had  produced  too  optimistic  results 
•vith  almost  every  .set  of  data  it  was  apjilied  on.  This  was  interpreted  as  a  result  of  either  the 
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unreality  of  the  underlying  assumptions  of  the  model,  or  poor  estimates  of  the  parameters,  due  to 
the  use  of  the  ma.ximum  likelihcioil  method.  The  HJ M  is  a  Bayesian  approach  to  the  J .M  model 
with  slight  modeling  changes.  It  does  not  consider  the  failure  rate  to  be  an  integer  multiple  of  c>. 
The  sequence  of  this  model  can  he  described  as  follows: 

1.  A  “prior"  distribution  is  a.s.sigiied  to  the  parameters  A  (initial  failure  rate  of  the  program) 
and  <j)  (usually  Gamma  pdf), 

2.  Using  the  observed  data  ■  '.U-i,  the  distribution  is  modified  to  give  the  “posterior” 

distribution  of  A  and  4>, 

3.  The  model  is  then  used  to  calculate  the  current  reliability,  the  current  failure  rate,  the  mean 
time  to  failure,  and  the  number  of  faults  remaining  in  the  program  under  test. 

Goel-Okumoio  Imperfect  Debugging  Model  (GO):  This  model  [31,  32],  is  another  mod¬ 
ification  of  the  basic  Jelinski-Moranda  model.  The  motivation  for  the  introduction  of  this  model 
was  the  fact  that  in  practice,  the  assumption  of  a  perfect  debugging  process  is  proved  to  be  unreal¬ 
istic  in  most  cases  [60,  86,  87].  The  modification  was  then  made  by  introducing  a  probability  o  for 
imperfect  debugging.  The  number  of  faults  in  the  program  at  any  time  <,  is  treated  as  a  Markovian 
process  with  the  transition  probability  q.  Times  between  transitions  are  taken  to  be  exponentially- 
distributed  with  rates  depending  on  the  number  of  faults  remaining  in  the  program.  The  hazard 
rate  between  the  (i  —  1)—  and  the  i—  failure  ,  Z(/,)  is  given  as: 


Z(i,)-  A[A'  -  q(,-  -  1)] 


(2.7) 


where 

t,  =  the  time  between  the  (i  —  1)—  and  the  failure 

A  =  the  failure  rate  per  fault 


2-19 


Expressions  are  then  derived  for  performance  measures  such  as  the  distrihiition  of  lime  to  a  com¬ 
pletely  debugged  program,  distribution  of  the  riuinber  of  faults  remaining  in  the  program,  and 
program  reliability. 

Ltitlewood-  Verall  Model  (LV):  Littlewood  and  X'erall  [5,o],  look  a  different  approach 
when  they  developed  this  model.  Unlike  most  other  models,  they  argued  that  software  reliability 
should  not  he  related  to  the  number  of  faults  in  the  program.  In  this  model,  it  is  possible  that 
fixing  a  fault  makes  the  program  less  reliable  and  even  if  an  improvement  took  place,  its  magnitude 
is  uncertain.  The  assumptions  of  the  model  are; 


1.  The  times  between  failures  T^s  are  assumed  to  be  independent  random  variables  (as  in  JM 
or  BJM)  with  pdf 


p{U  I  A,)  =  A,  exp(-A,<,)  (ti  >  0) 


(2.8) 


i.e.  the  random  variables  T^s  are  exponential  with  parameter  A^, 

2.  The  A's  form  a  sequence  of  random  variables  each  has  a  gamma  distrihiit  ion  with  the  param¬ 
eters  a  and  iHi],  i.e.. 


/(A,  |a,r/.(f))  = 


r(a) 


A.  >  0 


(2.9) 


The  function  is  a  linear  function  of  t,  reflecting  the  quality  of  the  programmer  and  the  difficulty 
of  the  programming  titsk.  A  rapidly  increasing  function  ^'’(f)  reflects  a  good  programmer,  an  easy 
task  or  both. 

Th--  user  can  choose  the  parametric  family  for  In  [1],  the  parametric  form  of  t/-(t)  was 

taken  as 

V(i,d]=  3i+i3,i  (2.10) 
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The  MLE  inelliod  is  used  to  estimate  the  values  of  Ji.  d-j  and  o  Tsing  the  realized  failure  times 


the  reliability  of  the  system  is  estimated  to  he  [l:9.')4] 


R,U) 


v(<.  3) 

i  + 


(2.11) 


where  S  and  ^  are  the  ML  estimates  of  o,  This  model  can  also  adjust  the  correction  time  to  be 
a  constant  value  greater  than  zero. 


2.4.5  KeUer-Liiikwood  Model  (KL):  This  model  [41.  42]  is  similar  to  LV,  except  that  reli¬ 
ability  grov,i,h  is  induced  via  the  shape  parameter  of  the  gamma  distribution,  i.e., 


1(^10,  Hi))  = 


exp  -,3X, 

HHi)) 


A,  >  0 


(2.12) 


Here,  reliability  growth  takes  place  when  Hi)  ^  decreasing  function  of  i.  Again  V’(*)  choice  is 
under  the  user  control.  In  [1:954],  the  parametric  form  of  Hi)  taken  as 


=  (qj  -l-ooi)”’ 


(2.13) 


The  .MLE  method  is  also  used  to  estimate  the  values  of  Oj.  02  and  tpii).  Using  realized  failure 
times  ■  ,<1-1,  the  reliability  of  the  system  is  estimated  to  be  [l:9a4] 


0 


i  3 


(2.14) 


where  a  and  t’(0  the  ML  estimates  of  a,  Hi)- 


2.4.6  .Mn.sa  no.-iic  Eiccultov  Time  Model:  This  model  [03]  is  one  of  the  most  commonly 
used  models  in  the  software  reliability  field.  What  is  interesting  about  this  model  is  that  it  uses 
execution  time  (which  is  the  rc,il  stress  and  mcariingfiil  time  for  software)  instead  of  the  calendar 
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time  used  liy  i.lier  iiu.dels.  Oil  the  other  hand,  this  model  can  also  traiisforiii  exc,  u.ioii  tune 
into  calendar  time,  which  is  more  convenient  for  software  reliability  managers  and  engineers.  It  is 
also  jxissible  to  niodi'l  the  amount  of  limiting  resources  (testers,  debuggers,  and  coiiipiiter  time) 
involved  in  tlie  testing  process. 

The  model  starts  with  tissuming  the  hazard  rate  function  Z(r)  to  be 

Z(t)  =  /K(No-7i(r))  (2.15) 

where 

f  =:  amount  of  execution  time  used  in  testing 
No  =  initial  number  of  faults  in  the  program 

/  =  linear  execution  froqiiencv  (average  instruction  rate  divided  by  the  t  tal 

nutnber  of  instructions  in  the  program) 

h  =  error  exposure  ratio  which  relates  the  error  exposure  frequency  to  linear 
exocutioti  frequency 

r?(-)  =  nunihcr  of  faults  detected  by  time  r 

Assutiiing  that  the  rate  of  failure  occurrence  is  proportional  to  the  rate  of  error  correction,  then 

^  (2.16) 

'vliere  R  is  the  error  roducliori  factor  wliich  represents  the  average  ratio  of  the  rate  of  reduction  of 
errors  to  the  rale  of  failure  occurrcnc.*, 

1  he  ahoN'e  equation  was  further  generalized  hy  introducing  a  constant  C  to  represent  the  ratio 
of  rate  of  error  detection  in  the  testing  phase  to  that  in  the  operational  phase,  so  Eq  (2.16)  can  be 
exiiressed  ns 

(lv(  r ) 

=  BCZ(t)  (2.17) 


combiniiiR  Eqs  (2.1o)  anti  (2.17).  we  j:,et 

=  BCfK[X,  -  n(r)]  =  BCfKNo  -  BCfKnir)  (2.18) 

dr 

Knowing  that  n  =  0  at  t-  =  0,  the  solution  of  the  above  equation  is  found  to  be 

n(r)  =  N,[\  -  expi-BCfKr)]  (2.19) 

The  MTTF  can  then  be  calculated  cis 

MTTF  -  1/Z(t)  =  l/[fKNoexp{-BCfKT)]  (2.20) 

The  reliability  of  the  system  at  future  execution  time  tj  will  be 

Rin )  =  exp(-  ^  Z(x)dx)  =  exp  (2-21) 

/ 

Other  useful  results  that  can  be  derived  from  this  model  include: 

1.  The  number  of  faults  to  be  detected  to  increase  the  time  between  failures  from  tj  to  r-t, 

2.  Additional  CPU  test  time  required  to  achieve  the  above  goal, 

3.  The  resource  requirements  needed  for  the  same  reason, 

4.  Utilization  factor  of  the  limiting  resources. 

2.4.  7  Musa  Logarithmic  Poisson  Eiecution  Time  Model:  This  is  another  e.xecution  time 
model  developed  by  Musa  and  Okumoto  [67]  in  I9S4.  It  assumes  an  infinite  number  of  faults  in  the 
program  and  the  failure  process  is  a  NHPP.  Further,  the  failure  intensity  A  is  assumed  to  decrease 
.  '  t.r  ,,iontially  with  tlie  number  removed  faults,  i.e. 
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A(r)  =  Xcex}i{—0n(T)) 


(2.22) 


wliere  Xo  initial  failure  inletisily,  and  o  is  called  the  failure  intensity  decay  parameter. 


Substituting  for  A(r),  we  get 


dn(r) 

dr 


XoCrp(-d>n(T)) 


(2.23) 


Using  the  initial  condition  that  n(0)  =  0,  the  solution  of  the  above  differential  equal  oi.  s 


n 


(r)  =  ^en(Xc<i>T+  1) 


(2.24) 


It  is  clear  from  the  above  equation  that  the  expected  number  of  faults  detected  by  execution  time 
r  is  a  logarithmic  function  of  r,  and  hence  the  name  of  the  model. 

Using  Eqs  (2.22)  and  (2.24),  the  failure  intensity  at  execution  time  r  is 


A(r)  =  A<,e2p[— <6n(r)]  = 


Aq 

Xc,0r+  1 


(2.25) 


The  reliability  function  at  execution  time  is 


R(t  I  = 


XQ<i>T  -{-  1 


Xo<!>{~  +  "o)  +  1 


,  r  >  0 


(2.26) 


Other  reliability  measures  can  be  obtained  using  the  general  theories  of  the  NHPP  models,  as 
de.scribed  in  Musa  and  Okumoto  [67]. 


2-24 


III.  SOFTW.AHE  RELI.ABIIJTY  .MODEL  .^ELECTION 


Software  Reliability  models  differ  considerably  in  I  lie  wa%s  lliey  iraiisforni  model  assumiitioiis 
into  a  detailed  matlieniatical  structure.  The  problem  of  proper  model  selection  can  be  summa¬ 
rized  briefly  as  follows  [52:149]:  The  available  set  of  data  to  the  user  will  be  a  sequence  of  times 
between  successive  failures  These  observed  times  are  the  realization  of  random  vari¬ 
ables  Ti,T2.  A  software  reliability  model  is  then  applied  to  use  the  observed  set  of  data 

(i ,  f 2.  b  - 1,  t.o  predict  the  future  unobserved  Tj,  ,  •  •  •.  The  problem  to  be  solved  by  a  software 
reliability  model  is  then  a  prediction  problem.  It  involves  the  future  via  the  unobserved  random 
variable  TJ.  Using  the  goodness  of  fit  will  not  solve  the  problem.  The  reason,  as  pointed  out  in 
[1:951]  is  that  models  are  usually  too  complicated  for  a  traditional  ”goodness-of-fit'’  approach  to 
be  used.  In  the  literature,  there  are  many  suggestions  for  solving  the  problem  of  proper  model 
selection.  Some  of  these  suggestions  will  be  given  in  this  chapter. 

3.1  .Model  Selection  Using  Analysis  of  Predictive  Quality 

The  idea  behind  this  method  is  to  do  some  analysis  about  the  predictive  quality  measures 
(such  as  accuracy,  bias,  trend,  noise,  •  •  -  etc.)  for  candidate  software  reliability  models,  with  respect 
to  the  set  of  data  in  hand.  Detailed  examples  of  these  analyses  can  be  found  in  [1]  ,  [41],  [42],  and 
[52].  brief  summary  of  such  methods  will  be  given  in  the  following  discussion. 

Given  that  the  ob.served  values  <i,  <2,  •  • -b-i  of  the  random  variables  Tj  ,T2,  ,7', _i,  the 
manager  of  the  software  product  will  be  interested  in  having  a  good  prediction  for  the  future  T,. 
This  future  Ti.  can  then  be  transformed  into  the  current  reliability  of  the  software  product  as 
follows: 

R,{t)  ^  \  -  P{T.  <  t)  =  \  -  FM)  (3.1) 
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The  user  will  never  know,  even  at  a  later  stage,  the  exact  value  of  F,(t).  However.  In  using  a 


software  reliability  model  the  estimated  value  Fi{()  can  be  calculated.  By  realizing  the  actual  value 
of  T,  at  the  time  of  next  failure,  the  user  will  have  a  pair  After  having  enough  pairs  of 

such  data,  the  user  can  tell  whether  there  is  any  evidence  to  suggest  that  the  t'.s  are  realizations 
of  random  variables  from  If  such  evidence  were  not  found,  it  would  suggest  that  there  are 

significant  differences  bet.ween  Fi{t)  and  Fi{i)\  hence;  the  predictions  are  not  in  accord  with  actual 
behavior.  Littlewood  [52:166]  made  the  following  sequence  of  transformations: 

u,  =  F,iU)  (3.2) 

Each  is  a  probability  integral  transform  of  the  observed  ti,  using  the  previously  calculated  predictor 
based  upon  <1,^2!  -ih-i'  According  to  Dawid  [22]  and  Rosenblatt  [79],  if  each  F,  were  identical 

to  the  true  f,  ,  then  u,  would  be  realizations  of  independent  uniform  L1(0, 1)  random  variables. 

/ 

3.1.]  the  u-Ploi:  The  main  idea  behind  this  method  is  that  since  {u's  )  are  supposed  to 
have  a  uniform  distribution,  then  the  quality  of  the  software  reliability  model  can  be  measured  by 
whether  the  sequence  of  u's  looks  like  a  random  sample  from  U{0, 1).  Knowing  that  the  cumulative 
distribution  function  (cdf)  of  f/(0,  1)  is  a  line  of  unit  slope  through  the  origin,  the  u-Plot  can  be 
used  to  judge  the  prediction  quality  of  a  software  reliability  model  as  follows: 

1 .  place  the  u,  values  on  the  horizontal  axis, 

2.  At  each  point,  increase  the  step  function  by  l/(n  +  1), 

3.  Compare  the  resulting  plot  with  the  line  of  unit  slope, 

4.  The  deviation  from  this  line,  which  can  be  measured  using  the  Kolmogorov  distance  (maxi¬ 
mum  absolute  vertical  difference)  will  be  used  to  measure  the  quality  of  the  software  reliability 
model. 
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Figure  3.1.  Drawing  the  u-Plot  (Littlewood  [52:168]) 

Another  quality  metric  that  can  be  deduced  using  the  u-Plot  is  the  bias  of  the  model.  If  all  of  the 
u-s  are  above  the  line  of  unit  slope,  then  this  means  that  the  model  predictions  tend  to  be  too 
optimistic  and  vise  versa  if  all  of  the  u's  are  under  the  line  of  unit  slope. 

3.1.2  The  y-Ptot  and  Scatter  Plot  ofv[s:  One  problem  with  the  u-Plot  is  that  it  measures 
only  one  type  of  departure  of  predictors  from  reality.  For  example  if  a  prediction  system  applied 
for  a  set  of  data  shows  optimism  in  tlie  early  predictions,  and  pessimism  in  the  later  predictions, 
then  a  small  Kolmogorov  distance  will  be  observed.  It  seems  necessary  then  to  examine  the  u's  for 
trend.  To  do  that,  the  y-Plot  method  makes  the  following  transformation 

I,  =  — ^n(l  —  tr.)  (3.3) 


3-3 


If  the  (i/l.-'}  are  a  true  realization  of  ltd  randoni  vanafiles  with  /  (0.  1)  distribution,  then  the  {  j-'.s} 
will  he  a  realization  of  in/  unit  exponential  raiuloin  variatiles.  '1  Ini.s.  il  tile  {  jj.s}  are  pioileu  on 
the  horizontal  axis,  then  they  sliould  look  like  a  realization  of  a  homof^eneoiis  Poisson  |>rocess.  Tlie 
alternative  liypolliesis  (that  there  is  trend  in  the  ujs)  will  show  itself  as  a  non-constant  rate  for 
this  process  If  the  values  of  are  normalized  onto  (0,1)  and  their  values  are  |)lottcd,  then  a 

plot  that  shows  the  trend  of  the  predictions  of  tlie  model  will  result  (se<'  Figure  3.3),  Dejiarture 
from  tlie  line  of  unit  slope  will  indicate  that  the  prediction  system  is  not  capturing  the  ‘‘t  rend"  in 
the  failure  data  (i.e.  reliability  growth)  (dl,  -12].  Figure  (3.3)  shows  the  application  of  the  y-Plot 
procedure  to  the  Littlewood-Verall  (LV)  and  Jelinski-Moranda  (JM)  jiredict  ions  of  the  table  1  data 
in  [52:144],  The  Kolmogorov  distances  are  found  to  be  0.120  for  (JM)  and  O.llO  for  (LV),  both  of 
them  are  not  significant  at  the  10%  level  [52:170],  A  close  look  at  the  JM  y-Plot  shows  that  it  is 
very  close  to  linearity  at  early  stages  (until  about  i=90:  see  the  fitting  line). 
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F  igure  3.4.  Scatter  Plot  of  n,  for  JM  Model  fising  Data  of  Table  1  in  [52:173] 


li]  llie  scatter  plot,  the  values  of  {i/Js}  are  ploti.erl  as  in  figure  (3.4)  and  the  trend  can  be 
judged  by  the  number,  atid  location  of  points  in  each  stage.  As  an  example,  it  is  clear  from  tlie 
plot  that  the  prediction  system  seems  to  be  tocj  optimistic  after  i  —  90.  TOis  is  mainly  because 
the  number  of  points  with  ■(  w's}  less  than  0.5  after  /  =  90  is  higher  than  t  host*  with  u,  greater 
than  0.5. 


S.J.3  Measures  of  Noise:  Both  the  u-Plot  and  the  y-Plot  can  be  considered  as  a  measure 
of  bias.  In  the  sequel  some  tools  will  be  used  to  atialyze  the  variability  of  the  prediction.  These 
tools  are,  in  fact,  some  quite  crude  tneasures  of  variability,  due  to  the  problem  of  unavailability  of 
the  true  sequence  of  f,(0  [52:175], 


3. 1.3.1  Braun  Statistic:  This  is  a  measure  of  predictions  noise.  It  is  defined  as  [13]: 


j _ ^  -  1 


(3.4) 


where 

E{Ti)  =  the  estimated  mean  of  Tj 

Ti  =  number  of  the  terms  in  the  sum 

A  small  value  of  B  indicates  better  smoothing  of  software  reliability  model  predictions. 

3. 1.3. 2  Median  Variability:  This  is  another  measure  of  noise,  which  is  defined  as 


M  V 


m,  -  m,_  1 


m,_i 


(3.5) 


where  m,  is  the  predicted  median  of  Ti .  Between  different  prediction  systems,  this  measure  can 
indicate  which  model  has  higher  variability  in  its  predictions,  or  in  other  words,  how  noisy  the 
model  predictions  are.  Again,  a  small  value  of  M\  indicat.es  better  smoothing  of  the  predictions. 
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:i.  1.3-3  Half  \  ar-iahility:  'Flie  rate  variability  ( /^l' )  is  defined  as 

-  fi-i 
'■-i 

where  r,.  tiie  rate  uf  ocr iir^'iice  r)f  failures  (/tOCOF),  is  calculated  immediately  after  a  fix.  This  is 
also  another  measure  of  noise.  It  is  important  to  note  that  for  both  MV  and  HV ,  the  comparison 
between  two  prediction  systems  must  be  for  the  same  set  of  data. 

3.1.4  Prtqueniial  Likelihood:  Most  of  the  work  concerning  the  Prequential  Likelihood 
was  done  by  Dawid  [21,  22].  The  Prequential  Likelihood  (PL)  for  one-step  ahead  prediction  of 
Tj  +  i  ,T]  +  2,  ■  ■  Tj+n  is  defined  as  follows[52;177]: 

j+n 

PLn=  n  (3.7) 

.=j  +  i 

where  /,(<)  is  the  pdf  of  the  predictive  distribution  F,(0,  based  on  the  realized  values  f] .  fo.  <,_i . 

/ 

The  PL  value  can  be  used  to  determine  the  accuracy  of  a  soft  ware  reliability  model  [57:174]. 
This  value  is  usually  very  small,  therefore  its  logarithmic  value  (which  is  always  negative)  is  used  for 
comparison.  The  more  negative  it  is,  the  more  inaccurate  the  software  reliability  model  predictions. 
This  measure  can  be  considered  as  a  general  procedure  for  choosing  the  best  prediction  system  for 
a  given  set  of  data  [14:461],  so  in  case  of  having  a  tie  between  two  models  with  respect  to  all  other 
quality  me;isures.  the  one  with  higher  accuracy  will  be  preferable  [57:174]. 

.•\  comparison  of  two  prediction  systems  A  and  B,  over  a  range  of  predictions  Tj  +  i ,  7^4.2,  ,  Tj+n 

can  be  made  via  their  prequential  likelihood  ratio  {PLR)n.A.B 

}+u 

n 

iPLR)„,A.B='-^ -  (3.8) 

n  ^(h) 

i=j-i-i 
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ifi 


X  . 


he  considered  better  tlian  B.  Detailed  discussion  al'oiit  lliesc  measures  can  he  found  in  [l],[21]. 
[22].  and  [37], 


Model 

u-plol 

K-S  dist. 
(sig.  level) 

y-  plot 
K-S  dist. 
(sig. level) 

Braun 

Slati.-itir 

(rank) 

.Median 
\  aria  bility 
( rank ) 

Rate  of 
Variability 
( rank) 

-lofiAPl) 

( rank) 

Jeliiiski-Moranda 

.121 

.115 

1.1 1 

4.23 

3.81 

466.22 

JM  [38] 

(NS) 

(NS) 

(») 

(0) 

(8) 

(0) 

Bayesian  JM 

.110 

.077 

1.04 

3.27 

BJM  [53] 

(NS) 

(NS) 

(3) 

(7) 

Littlewood 

.123 

.091 

1.07 

4.66 

L  [51] 

(NS) 

(NS) 

(7) 

■BH 

(9) 

Bayesian  Littlewood 

.138 

.068 

.90 

465.18 

BL  [2] 

(NS) 

(NS) 

(1) 

(1) 

Littlewood-Verall 

.167 

.051 

.97 

2.33 

2.18 

465.52 

LV  [55] 

(10%) 

(NS) 

(3) 

(3) 

(4) 

(3) 

Keiller-Lit  tie  wood 

.170 

.051 

.96 

2.33. 

2.17 

465.81 

KL  [41,  42] 

(10%) 

(NS) 

(1) 

(3) 

(3) 

(4) 

Duane 

.209 

.052 

1.84 

467.78 

D  [27,  18] 

(2%) 

(NS) 

■BiH 

(2) 

(9) 

Goel-Okumoto 

]27l 

.085 

1.21 

1.06 

1.03 

473.87 

GO  [31] 

(1%) 

(NS) 

(10) 

(1) 

(1) 

(10) 

Littlewood  NHPP 

.169 

.082 

.97 

3.05 

2.76 

465.85 

LNHPP[1] 

(10%) 

(NS) 

(3) 

(5) 

(5) 

(5) 

Wei  bull 

.100 

.111 

1.17 

6.16 

5.48 

466.89 

W  [2] 

(NS) 

(NS) 

(9) 

(y) 

(10) 

(8) 

Table  3.1.  Littlewood’s  Analysis  of  Data  of  Table  2  in  [52:189] 


Table  (3.1)  is  a  summary  of  applying  the  above-mentioned  prediction  quality  measures.  From 
this  table,  it  is  clear  that  different  methods  of  model  selection  result  in  different  models  being  chosen. 
This  problem,  and  the  fact  that  some  of  the  above  methods  are  rather  subjective  as  to  which  model 
is  better  than  others  [45:184],  force  the  user  to  try  different  measures  and  take  the  average,  or  to 
judge  the  results  from  his  own  perspective. 

3.2  Model  Selection  Based  on  a  Linear  Combination  of  Models 

The  idea  behind  this  method  is  that,  rather  than  predicting  software  reliability  by  using 
only  one  model,  a  meta  predictor  could  be  formed  to  take  a  linear  combination  of  two  (or  more) 
predictions,  with  weights  cho.scn  in  some  optimal  way. 


3-8 


'I  Ik-  lieiirislic  algonlhm  for  this  nietliod  is  as  follows  [57:173] 

1.  Identify  the  candidate  set  of  software  reliability  models  to  be  used. 

2.  Select  the  models  that  tend  to  cancel  out  in  their  biased  predictions  (if  any). 

3.  Selected  models  are  equally  weighted  to  form  a  linear  combination  model. 

4.  The  arithmetic  average  {mean  value)  of  the  predictions,  resulting  from  the  .selected  models 
or  their  middle  prediction  value  (  median  value),  is  used  as  the  prediction  of  the  linear 
combination  of  models. 

The  authors  used  the  Goel-Okumoto  NHPP  Model  (GO)  [33],  the  Musa-Okumoto  Logarithmic 
Model  (MO)  [67],  and  the  Littlewood-Verall  Model  (LV)  [55]  to  form  an  Equally- Weighted  Linear 
Combination  (ELC)  Model.  The  arithmetic  average  of  each  selected  models’s  predictions  was  taken 
as  the  ELC  Model  predictions  as  follows: 

ELC  =  \gO+\mO+\lV  (3.9) 

The  main  drawback  of  this  method  is  that  it  is  not  the  best  in  all  cases.  Also  it  mixes  models  of 
different  assumptions  for  the  failure  process. 


3.3  Model  Selection  Based  on  Check  of  Limits 


In  this  approach,  a  check  of  the  limit  conditions  for  the  model  to  be  used  is  performed 
before  using  it,  so  as  to  avoid  the  meaningless  consumption  of  time  [93:481].  The  check  of  the  limit 
conditions  confirms  the  convergence  of  the  model.  As  an  example  of  this  technique,  H.  Xizi  [93:483] 
derived  the  limit  condition  for  the  Musa  Execution  Time  Model  [63]  as: 


_ 

m 

X'. 

t=i 


< 


m-  1 


2 


(3.10) 
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vvlit'rt- 


ni 


"c 


B 

t, 


=  llr/B 

=  number  of  errors  corrected 
=  error  reduction  factor 

=  llie  time  between  the  (i  —  1)—  and  tlie  i—  failures,  i  =  1, 2,  •  ■  ■ ,  rrj 


Litt.lewood  [5-1:Ho]  presented  the  convergence  condition  for  the  Jelinski-Moranda  model  (JM)  [38] 


as: 


1  =  1 
n 


D'-‘i 


1=1 


(3.11) 


where 

n  =  observed  number  of  failures 

ti  =  the  time  between  the  (r  —  1)—  and  the  i—  failures  r  =  1, 2,  •  •  • ,  n 


The  problem  with  this  method  is  that  the  limit  conditions  for  most  of  the  models  are  similar,  which 
makes  the  u.ser  return  to  the  the  same  problem  of  proper  model  selection. 


3.4  Model  Selection  Using  Akaike  Information  Criterion  (AlC) 

The  (AlC)  was  developed  by  Akaiki  [3]  in  1974.  It  resulted  from  relating  the  entropy  principle 
from  statistical  mechanics  to  information  theory.  In  a  subsequent  work  [4],  Akaiki  proved  that  the 
(AIC)  can  be  used  to  select  the  model  that  best  predicts  the  stochastic  behavior  of  the  system. 

The  use  of  the  Akaike  Information  Criterion  for  software  reliability  model  selection  was  first 
suggested  by  Khoshgoftaar  [43].  In  a  subsequent  work  [44],  he  showed  that  this  technique,  when 
applied  with  some  c.xtensive  simulation  work,  proved  the  feasibility  of  using  the  (AIC)  for  software 
reliability  model  selection. 
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Entropy  in  statistical  mechanics  is  the  iri<-asiirc  of  the  probability  of  having  a  system  of 
particles  in  state  A.  It  increases  with  the  system  changing  to  its  most  probable  state  B.  If  A  =  B, 
entropy  will  be  rnaximiirn  and  can  be  taken  as  the  measure  of  how  close  the  estimator  is  to  its  real 
distribution.  For  two  probability  density  functions  /(r)  and  g(:),  tlie  entropy  of  distribution  /(r) 
with  respect  to  distribution  g{i),  denoted  as  B{f(z),g(z))  is  expressed  as  [45:186] 

B(f(z),g(z))  =  -  j  f(,)en  dz  (3.12) 

=  -/(/(-’):  s(-)),  (3.14) 

where 

■E/  =  the  expectation  with  respect  to  distribution  f{z) 

^(/{-)l!/(-))  =  the  expected  log-likelihood  ratio,  or  tlie  negative  of  entropy 

C  =  a  constant  value 

The  software  reliability  model  that  minimizes 

-  2^n  j -t- 2C  (3.15) 

is  the  model  that  should  be  chosen  Khoshgoftaar  and  Woodcock  [45:187]  stated  that  the  AIC  can 
be  written  as  the  following  expression: 

AIC  =  -2(log  likelihood  function  at  its  maximum  likelihood  estimators  )  -|-2  (number  of  parameters 
fitted  when  maximizing  the  likelihood  function  ) 

The  best  model  for  a  given  data  set  using  this  method  is  that  with  the  lowest  AIC  value. 
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3.5  Recalibraiiiifi  Software  Reliahilny  Model.'i 


This  method  was  introduced  hv  Brockleliurst  and  Others  fl-i],  and  can  be  summarized  as 
follows: 

The  relation  between  true  distribution  Ft{t)  of  the  random  variable  7',  ,  and  the  predicted  one 
F,{t)  can  be  represented  through  a  relation  function  G,  as 


F.(0  =  G.  [f.(/)]  (3.16) 

It  is  further  tissumed  that  G,-  is  only  slowly  changing  function  with  i.  Since  G,-  is  not  known,  it  will 
be  approximated  with  an  estimate  G*  which  will  lead  to  a  new  prediction 

^•(0  =  G:  [f.(0]  (3.17) 

This,  in  fact,  recalibrates  the  raw  model  output  F,(f)  in  the  light  of  the  accuracy  of  past  predictions 
for  the  data  set  under  study.  The  authors  based  their  estimate  of  G"  on  the  u-Plot,  calculated  from 
predictions  which  have  be  ■  made  prior  to  7).  They  made  two  choices  for  the  shape  of  G'(/).  The 
first  choice  is  a  simple  shape  in  the  form  of  a  u-Plot  with  stops  joined  up  to  form  a  polygon,  while 
the  second  one  is  a  more  complicated  one  in  the  form  of  a  spline. 

The  secpience  of  this  method  can  be  summarized  as  follows  [14:461]: 

1 .  Use  the  y-Plot  to  make  sure  that  the  error  in  previous  predictions  is  approxim.alely  stationary, 

2.  Construct  the  polygon  G’  by  joining  up  the  steps  of  the  u-Plot  formed  by  predictions  before 
T, .  see  Figure  (3.5), 

3.  Get  the  raw  prediction  F(/)  by  using  the  basic  prediction  system, 

4.  Recalibrate  the  raw  predictions  using  Eq  (3.17). 
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Figure  3.5.  Drawing  the  Step  Recalibrating  Function  G'  (Brocklehiirst  [14:461]) 

The  main  problem  with  this  technique,  as  stated  by  the  authors,  is  that,  the  failure  behavior  of 
software  cannot  be  guaranteed  to  be  stationary  in  ail  cases.  Also,  recalibrated  predictions  can 


sometimes  be  worse  than  raw  predictions. 


IV.  M.VTHEM.ATIC.AL  BACKGROUND 


In  this  chapter,  several  mathematical  concepts  of  tlie  reliability  theory  will  be  presented. 
These  concepts  are  essential  for  uiider.standing  tlie  process  of  software  reliability  modeling.  The 
most  important  distributions  in  reliability  theory  and  the  relations  between  these  distributions  are 
also  given  in  this  chapter.  The  chapter  .oncludes  with  a  derivation  of  the  test  statistic  and  its 
moments. 

Throughout  this  discussion,  the  random  variable T  will  be  used  to  represent  the  time  to  next 
failure,  and  t  will  represent  the  realization  of  T. 

4-1  Fundamenlal  Rtliabiltiy  Equations 

There  are  some  principles  in  hardware  reliability  theory  that  are  also  applicable  in  software 
reliability  theory. 

The  first  common  principle  is  that  the  reliability  of  a  system  (program)  at  time  t,  R{t)  is 

I 

defined  as  the  probability  that  there  will  be  no  failures  by  t,  i.  e. 

R(t)  =  P{T  >t)  =  l-P{T<t)=l-  F{i),  (d.l) 

where  F(t)  is  the  probability  of  failure  before  time  t. 

Also,  the  failure  rate  is  defined  as  the  probability  that  a  failure  per  unit  time  occurs  in  the 
interval  between  two  times  given  that  the  system  (program)  has  survived  until  time  t\: 

Pjti  <T  <  t.lT  >  h) 

(<2  -  <l) 


Pjtl  <T<t2) 
{t2-h)P{T  >  t,] 
f(t2)~F(tO 

(<2  —  ti)R(ii ) 


(4.2) 

(4.3) 
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Tfie  hazard  rate  Z(t)  for  a  component  {aojtirari  program)  is  defined  as  the  instantaneous  failure 
rate  at  time  i.  Therefore,  ii  can  be  expresseil  as  the  limiting  condition  of  Eq  (d.d)  a.s  the  interval 
(1 2  —  ti)  approaches  0,  so 


r(/)  =  lim 


F(i^AI)-F(t)  fit)  fit) 


Ai-o  StR(t)  R(l)  1-F{t) 


(4.4) 


where  f(t)  is  the  failure  density  or  the  first  derivative  of  E(t). 

The  relation  between  2(1)  and  /2(f)  rate  can  be  derived  by  integrating  the  two  sides  of  Eq 
(4.4),  i.e. 

/2(f)=exp[—  /  Z(x)dx\  (‘^•5) 

Jo 

Using  Eqs  (4.1),  (4.4),  and  (4.5),  we  get 


fit)  =  Z(<)exp[-  /  Zix)dx] 
Jo 


(4.6) 


The  mean  time  to  failure  (MTTF),  is  defined  fis  the  expected  time  to  the  next  failure,  and  can  be 
expressed  as 

MTTF=EiT)=  f  ifit)dt  (4.7) 

Jo 

It  can  also  be  computed  by  the  following  relation  [40;10] 


/ 

Jo 


MTTF=  /  Rit)dt 


(4.8) 


K  Nit)  is  the  number  of  failures  experienced  by  time  f,  then  the  mean  value  of  Nit)  is  /j(<)  =  E[N(t)], 
which  is  an  increasing  function  of  t,  and  its  derivative  is  the  failure  intensity  A(f)  =  dp(f)/c/i. 
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4-2  Some  Important  Rehabxlity  Distntiutions 

In  t  his  section,  some  of  tlie  important  ilistributions  used  in  reliability  studies  will  be  presented, 
along  with  the  relations  between  them.  There  are  also  some  theories  related  to  these  distributions, 
which  are  needed  for  the  derivation  of  the  test  criteria. 


4.S.1  The  Potsson  Distribution:  The  series 


m*  m 


Etti 

"zT 


(4.9) 


converges  for  all  values  of  m  to  e"*.  Consider  the  function  /(x)  defined  by 


I{^)  =  { 


z  =  0,1,2,  ... 

otherwise 


(4.10) 


where  m  >  0.  This  makes  /(x)  >  0  and 


E/(-)  =  E 


m^e 


r  =  0 


r— 0 


X! 


oo 

Y-  rn^ 

^  x! 
1=0 


=  1 


(4.11) 


thus,  /(x)  satisfies  the  conditions  of  being  a  pdf  of  a  discrete  type  random  variable.  A  random 
variable  X  which  has  a  pdf  of  that  form  of  f{x)  is  said  to  have  a  Potsson  distribution,  and  any 
such  /(x)  is  called  a  Poisson  pdf. 

4.f^.2  The  Gamma  Distribution:  For  any  positive  number  o,  it  is  known  that  the  integral 


i: 
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exists  for  o  >  0  [2.'i;235],  and  tlial  the  value  of  that  integral  is  a  positive  numher  called  t  he  Gamma 


function  of  o ,  where 


fOO 

(a)=  y^-^e-ydy 
Jo 


(4.12) 


If  Q  =  1,  it  is  clear  that 


r(i)=  r 

Jo 


e  ^dy  =  1 


(4.13) 


If  Q  >  1,  then  an  integration  by  parts  shows  that 


{a)  =  (a-l)  /  y“-V‘'dy  =  (Q-l)  r(Q- 1) 

Jo 


(4.14) 


Accordingly,  if  o  is  a  positive  integer  greater  than  1,  then 


r(a)  =  (a  -  l)(a  -  2)...(3)(2)(l)r(l)  =  (a  -  1)! 


(4.15) 


In  the  integral  that  defines  r(a),  let  us  introduce  a  new  variable  x  by  writing  y  =  xf0,  w’here 


0  >  0,  then 


roo  /  /l\ 


(4.16) 


Dividing  by  r(o),  we  get 


roo  1 

1  -  /  - 

Jo  l3»r(a) 


(4.17) 


Since  a  >  0,  0  >  0  and  r(Q)  >  0,  it  is  clear  that 


— ? — X  >  0 


otherwise 


(4.18) 


is  a  pdf  of  a  random  variable  of  the  continuous  type.  A  random  variable  A'  that  has  a  pdf  of  that 


form  is  said  to  have  a  Gawma  distribution  (A'~r(Q,/i)). 
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From  the  properties  of  the  pdf,  it  is  known  that 


I 


0  i^“r(a) 


(4.19) 


which  can  be  rewritten  as 


i-OO 

/  =  0‘^T{a) 

Jo 


(4.20) 


The  mean  and  variance  of  a  random  variable  X  having  a  Gamma  distribution  are 


E{X)  =  n  =  Q0  V(A')  =  a-  =  a0- 


4.S.S  The  Chi-Squared  Dtsirtbuiton:  If  v  is  any  positive  integer  (usually  referred  to  as 
degree  of  freedom),  then  a  random  variable  X  is  said  to  have  a  Chi-Squared  distribution  with 
parameter  v  (  A'  ~  f^e  pdf  of  X  is  the  Gamma  density  defined  in  (4.18)  with  q  =  v/2  and 

0  =  2.  Thus,  the  pdf  of  a  chi-squared  random  variable  A'  is 


/(x; v) 


r(v/2)2 

0 


1  ^,.(v/2)-l,-x/2 


X  >  0 

otherwise 


(4.21) 


The  mean  and  variance  of  a  random  variable  X  having  a  Chi-Squared  distribution  are 


^(A')  =  p  =  f  l'(X')  =  (T"  =  2v 


4.2-4  The  One- Parameter  Exponential  Distribution:  The  one-parameter  exponential  dis¬ 


tribution  is  another  special  case  of  the  general  Gamma  distribution  defined  in  (4.18)  in  which 
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(1  =  1  ami  has  been  replaceci  hy  a  i.e.  A’  is  said  to  have  a  cm  -pannuctt  i  f  r/icru  niial  (hstnbuUov 


(X  ~  ICX  1‘((t))  if  tlie  pdf  of  \  is 


-e  «  .r  >  0.  cr  >  0 

a  — 

0  otherwise 


(4.22) 


Tlie  mean  and  variance  of  a  random  variable  X  having  a  one-parameter  exponential  distribu¬ 
tion  arc 

^(A')  =  =  <r  and  V^(A)  =  rr" 


and  the  cumulative  density  function  (cdf)  is 


F{x-,(t)=  1 


(4.23) 


4.2.5  TheTwo- Parameter  Exponential  Disiritution:  A  random  variable  A  is  said  to  have 
a  two-parameter  exponential  distribution  with  parameters  0  and  a  {X  ~  EX  P{a\0))  if  it  has  a 
pdf 


f{x\e,a) 


X  >  0,  a  >  0 

O  —  ’ 

0  otherwise 


(4.24) 


where  0  is  the  ‘"threakold”  or  ‘‘guarantee  time"  and  <7,  is  usually  called  ‘‘the  mean  time  between 


failures 


From  the  definition  of  the  pdf,  one  can  write 


— c  ^  ^dx  =  /  — e  *  \lx  =  1 
<7  Je  a 


(4.25) 
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multiplying  both  sides  hv  rr  yields 


(lx 


a 


(4.26) 


The  cdf  of  the  two-paraniet.er  exponential  distribution  is 


F{x]oJ)  = 


f {x)dT 

1 


=  r 

Je 


e  a 


I  —t 

Je  a 

1  - 


(£) 


Je  cr 


=  _.(f)  [.-(f) 


(4.27) 


4  3  The  Moment  Generating  Function 

The  mean  and  the  variance  of  a  random  variable  X  are  special  cases  of  what  is  more  generally 
referred  to  as  the  moments  of  the  random  variable.  The  mean  E(x)  is  the  first  moment  around 
the  origin,  and  the  variance  <t~  is  the  second  moment  about  the  mean.  Higher  moments  are  also 
useful  for  characterizing  other  distribution  aspects  (e.g.  the  skewness  of  the  pdf  can  be  measured 
in  terms  of  its  third  moment  about  the  mean). 

The  classic  method  for  obtaining  the  riA  moment  of  a  random  variable  A’  is  to  eva'uate  the 
integration  /  x''  f{x)dx.  Integrals  of  that,  form  are  nt  always  easy  to  evaluate.  An  alternative, 

v/  -OO 

and  easy,  method  is  to  evaluate  the  moment  generating  Junction  .Mr(t)  which  can  be  defined  tis 

Definition  IV.l  For  all  real  values  of  t  for  which  the  expected  value  exists,  the  moment  generating 
function  (m.g.f.)  for  a  random  variable  X  with  a  pdf  ffx)  ,  denoted  Mr{t)  is 


MAt)  =  FAc'^) 


d^f(x)di 


(4.28) 
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Oiif  of  the  most  important  properties  of  MAt)  it-  that  its  r—  derivative  evaluated  at  zero 


( A/^(0  |o  )  is  equal  to  E(X'' )  [2d:lG3].  If  Mi(t)  can  he  found,  then  d/J(/)  will  he  ea.sier  to  evaluate 

than  f  x'^f(x)dr. 

J  —  CO 

■Applying  the  above  definition  for  the  Gamma  distribution  defined  in  ('1.18),  we  get 


f 


1 


/3“r(o) 


] 


/J^V(a) 


f 


dx 


(4.29) 


using  Eq  (4.20),  this  is  equivalent  to 


1  r(o) 

■(!-<)“ 


1 

(1  -  /30“ 


=  (1 


i.e.,  for  the  Gamma  distribution 


MAt)={\  - 


(4.30) 


For  the  Chi-squared  distribution  Mx{t)  is 


Af,(()  =  (1-21  )-’•/- 


(4.31) 


and  for  the  One-l^arameter  Exponential  distribution 

Mril)  =  (1  -  at)-' 


(4.32) 


.{.J,  Somf  Important  Relations 

In  the  following,  t  he  relations  between  the  different  distributions  will  be  explored. 

Theorem  IV. 1  If  X  has  a  two-parameter  exponential  pdf,  f{i\0.a)  defined  in  Eq  then 

(X  -  6)  has  a  one-parameter  pdf  f{x.a)  defined  in  Eq  {4-22). 
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Proof 

Let  V  =  X  -  6.  From  the  hypotliesis,  we  have  A'  ~  EX  P{6,a). 
exponential  distribution  described  in  (4.24).  The  following  lemma  [9:24.a] 
thrs  theorem 


Lemma  IV. 1  Given  the  pdf  of  X,  then  the  pdf  of  Y  where  g(X)  =  Y  is 


9iy)  =  fig  ‘(y)) 


From  the  assumption,  it  follows  that  X  =  g  ^(y)  =  Y  +  6  and 


dy 


g~  iy) 


=  1 


Therefore,  the  pdf  of  Y  is 


9{y) 


fix-.e.a) 


1  -(v4e-9) 

—  e  f- 
a 


1  ^ 


—  e  ” 

<7 


1  -(j-e)  , 

-e  ’ll 
a 


i  e..  the  pdf  of  can  be;  written  as 


giy) 


ie- 


0 


y  >  0,  cr  >  0 
otherwise 


where  EXP{0,a)  is 
is  required  to  prove 


(4.33) 


(4.34) 


(4.35) 


(4.36) 


which  is  the  pdf  of  a  one-parameter  exponential  distribution. 


Lemma  IV. 2  If  is  the  moment  generating  funcUou  of  X .  then 


M,,+6(0  =  e"’-A/x(fl/) 

Proof 

Mar+b{t)  =  •e"’) 

=  =  e**'  •  Mj-(at) 

Lemma  IV. 3  The  moment  generating  function  (m.g.f.)  of  X,  where  X  has  a  two-pnrameter  expo¬ 
nential  pdf  is 

M^{i)  =  e‘\l  -  at)-^ 

Proof 

Let  V'  =  A'  —  6,  then  Y  will  have  a  one-parameter  e.xponenlial  distribution  whose  moment 
generating  function  (m.g.f.)  is 

My(t)  =  (I  -  (Tt)-'  (4.37) 

since  .V  =  V  -f  0,  tlien  using  lemma(IV.2)  and  Eq  (4.32),  we  get 

Mrit)  =  e*^(l  -  erty^  (4.38) 

Theorem  IV. 2  Suppose  that  A'l ,  A'2,  •  •  • ,  A'„  are  independent,  and  Xi  has  m.g.f.  Alxi(t), 
iiliere.  i  —  \  .7.  ■■■  .n ,  then  the  m.g.f .  o/oi  A'l -f  njA'^o  +  ' ' '  +  OnA'n  is 

^'^a\X\+a2T2-\ - l-OnXn(0  ~  A/il  (Q]  f  )yVfi.2(tt2f  )  '  '  '  -^'^xn(^nO 


Proof 

The  proof  of  this  theorem  is  given  in  Ref.  [9:258]. 
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Theorem  IV. 3  Suppose  t/iai  ,Vi .  A'l.,  •  ■  • ,  A’„  are  independeui  and  each  has  a  pdf 
Gamma  then  the  pdf  of  A'l  +  .V2  +  ■  •  +  A'„  is  Gamma{ui  +  oo  +  •  •  +  <in-  i3)- 


Proof 

Applying  Theorem  (IV. 2)  we  have 


+X-2  H - hXn 

=  (1 


=  (1  —  --+0)1) 


i.e.,  A 1  +  At  +  •  ■  •  +  An  ~  G(irnma{a\  +  C12  +  ‘  > /?)  -- 

Theorem  IV. 4  If  a  random  variable  X  ~  Gamma{o,l3),  then  cX  ~  Gamma(Q,  cjf). 

Proof 

Since  A"  ~  Gamvia{cx,0),  tlien  its  m.g.f.  i.s 

A4(0  =  (i-/?0““ 

Applying  lemma  (IV. 2)  to  Mcx(t)  yields  Mi{ct)  whose  value  is  (1  —  0c1)~°  which  is  the  ni.g.f.  of 
Gamma  (a,  cd),  i.e., 

cX  ~  Gammaia  ,c0) 

Corollary  IV, 1  If  X  ts  a  one-parameter  eiponcntial  distribution,  then 

cX  ~  Gamina{  1 ,  ccr) 


•MI 


^.5  OrdfT  Siaitslics 


Suppose  that  the  ratidoiii  variable  X  has  a  continuous  pdf  f{r)  and  that  { A’l ,  A’_<,  ■  A„  [  is 

a  random  sample  from  this  dist  ribution.  Tire  A'  s,  rearranged  in  order  of  magnitude,  and  denoted 

'^(1)  <  ^(2)  <  ■  ■  •  £  '^(») 

are  called  the  order  statistics  of  the  sample.  A  few  results  about  order  statistics  will  be  given  here. 

Theorem  IV. 5  Let  A’(i)  <  A’(2)  <  ■  ■  •  <  A'(„)  be  the  order  siaitsttcs  from  a  population  with  s  pdf 
EX P{0,ff)  defined  in  Eq  (4-24),  then  the  pdf  of  Xi  is  EXP{0,i7fn) 

Proof 


m(,)<.T)  =i-(i-F,(x)r 


1  -  l+e 


-n[T-e) 

1  —  e  " 


The  derivative  of  the  above  cdf  of  A'(i)  is 


n  f-otT-C).  1  r-(»— e)i 

_ a  J  <r/n  * 

a  <r  jn 

Which  means  that  A’(i)  has  a  two- parameter  exponential  distribution  with  parameters  fi.a/n. 

Theorem  IV. 6  Let  Aj^  <  Xf^i  <  ■  ■  £  -^(n)  order  statistics  from  a  population  mill  a  pdf 

EXP{<t)  defined  in  Eq  (4~2)  then  the  pdf  of  X(\)  is  EX  P((t /n) 


Proof 


F(A-(,)  <  .r) 


=  I  -  (1  -  F^(2-))"  =  I  -  (1  -  ]  + 

—  n.T 

=  1  —  t.  "  —  1  —  e;"/" 
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Once  agaii.,  llie  derivalive  of  t  he  cdf  of  A’o)  is 


1 

ojn 


e 


whicli  means  that  yV^j)  has  a  one-jiaraineler  exponential  clislributioii  with  parameter  a/n. 


Tlieoreni  IV.7  Itt  A'  ,  A'j,  ■  •  ■ ,  A'„  be  independcni  aitd  tdeiitically  disiribuied  random  variables 
fnd).  with  pdf  EXP(cr),  then 

n 

A',-  ~  Gumrtia{n,cr) 

i  =  l 

Proof 

A'i  ~  EXP(a)  implies  A',  ~  Gamma(l,(T)  by  the  definition  of  the  exponential  distribution, 
then  by  using  theorem  (I\''.3)  we  get 

n  n 

Xj  ~  GammaC^  l-a-i 
1=1  1=1  , 

i.e,, 

n 

y  X,  ~  Gamm(i{n  .a)  (4.39) 

1  =  1 

Tlieoroni  IV. 8  if  X  ~  Gam7na{a.b)  then  ^  ~  \-{2:i) 

Proof 

X  ~  Gamma{a.  b)  implies  ^  ~  Gainnta{a,  =  Gamina[a.  2)  by  theory  (IV. 4)  and  tliis  is 
equivalent  to  \'(2a)  from  the  definition  of  the  Chi-Squared  distribution,  i.e  ,  ~  ~  ,\'^(2a). 

Theorem  IV. 9  // A'l ,  AA,  •  •  • ,  A'„  arc  independent  and  identically  distributed  random  variables 
with  pdf  EXP{(t),  then 

27'  .  " 

—  ~  \~{2n)  where  T  =  A', 

(T  ^ — ‘ 
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Proo f 


Because  A'l.A'j,  ■  .A',,  are  independent  and  identically  distributed  random  variables  with 
pdf  EXP((t),  then  T  ~  Gamma(ii,a)  eis  given  before,  and  by  the  last  theorem,  ~  will  be  a 
Chi- Squared  distribution  with  2n  degrees  of  freeoom,  that  is 


2T 

<T 


(4.40) 


4 -6  Type  II  Censoring 

A  type  II  censored  .sample  is  the  one  for  which  only  the  r  smallest  observations  in  a  random 
sample  of  n  items  are  observed  (1  <  r  <  n).  Experiments  involving  type  II  censoring  are  often 
used  in  many  situations,  such  as  software  failures,  where  the  test  is  terminated  at  the  time  of  the 
r—  occurrence  of  failure.  Such  tests  save  time  and  money,  since  it  could  take  a  very  long  time  for 
all  failures  to  occur. 

It  should  be  clear  that  with  type  II  censoring,  the  data  consist  of  the  r  smallest  times 
'^(i)  ^\'J)  ■■■  S  -^(r)  out  of  a  random  sample  of  n  times  A'l ,  AA,  A'n  from  the  distribution 
in  question.  If  A'l ,  AA.  ... ,  AA  are  independent  and  identically  distributed  random  variables,  and 
have  a  continuous  distribution  with  pdf  /(r),  it  follows  from  the  general  results  of  order  statistics 
[47:.ulS]  that  the  joint  pdf  of  A'fij  <  A'(2)  <  ...  <  A‘(r)  is 


fix 


(!)■  •'^■(2)^ 


(O)  = 


(n  —  r)! 


n  /{Hi))  1  -  r(.x») 


(4.41) 


Vl  =  l 
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As  an  example,  If  {A  j ,  A-.. . A'n)  is  a  random  sample  from  a  one-parameier  exponential  distribu¬ 


tion  whose  pdf  is 


jr  >  0,  fT  >  0 


and  know'ing  that  F{j-)  —  1  —  i.e. 


then  the  joint  pdf  of  A'(i)  <  A'(2)  <  <  A'(r)  is 


n!  -  J  r  1=1  .  e-(«-’-)^(r)/<' 

(n— r)!  a’’ 


.  -  J-e  Li=t 

(n— r)!  a’’ 

n'.  1  „-T/<t 
(n— r)!  a'' 


-i  +  (”  - 


where  T  =  +  (”  -  ^)^(r)  is  called  total  time  in  the  test  w’hose  pdf  is  Gamma{r,  a)  as  can 

.1=1 

be  proved  by  the  following  theorem. 


Theorem  IV. 10  The  total  time  in  the  test  T  has  a  dtsiTibuiion  which  can  be  defined  as 


T  Gamma{r,a) 

or  2T  Gamma{r,2a) 


or 


2T/(t  Gamina{r,2)  ~  ,\^2r) 


Proof 
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Substituting,  we  get 


5(H-,,  H-2,  . 

...in) 

call'd  ). 

n  —{d  —  1) 
0  («-l) 


0  0 


[n-r+l) 


(n  -  r)! 


Thus,  f{wi,W2,  ...,Wr)  can  be  expressed  as 


f{wuW2,...,Wr)  = 


=  _nL_Xe-^  1 _ 

(n— r)!  ff*'  n!/(n— r)! 


1  -T. 
=  —e 

a' 


i-1 


1 

—  o 


which  means  that  WV  are  independent,  each  with  a  pdf 


J{wi)  =  -e 

a 


Therefore,  T  —  can  be  defined  by 


T  GaiTtma(r,<T) 

or  2T  ~  Gamma(r,  2a) 

or  2Tfa  ~  Gamma {r,  2)  ~  X^r) 
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If  ttic  above  discussion  is  lo  lie  applied  for  the  two-parameter  exponential  distribution,  tfien  let 


A’l .  A'o, A'n  be  a  random  sample  from  a  two-|>araineter  exponential  distribution  with  a  pdf 


/(.t;  e.a)  = 


-e  "  X  >  f?  >  0.  (7  >  0 


otherwise 


If  'X(i)  <  A'(2)  <  . 

..  < 

pdf  of  A’(i),  A'(2),  . 

A'(r)  is 

.T(r)) 

-(i:)  -0)  +  (71  -  r)(x(,)  -  6) 

=  -nl _ Le  l.=i 

(n— r )!  ct' 


Theorem  IV. 11  Lei  A'’(i)  <  A'p.ij  <  ...  <  A'j,.)  be  the  order  statistic  from  a  two-parameter  expo¬ 
nential  distribution,  then 

(a)  72(.T(i)  —  B)  has  a  distribution  given  by  — — -  ~  X^2) 

fi)  V'r  has  a  distribution  given  by  ~  X2(r-i)  vvhere 


y;  = 


(a)  It  is  already  known  that  A'(i)  has  a  two-paranieter  exponential  distribution  EXP{6,<T/n)  and 
therefore  n(A’(i)  —0)  will  have  a  one-parameter  pdf  EXP(<t).  This  can  also  be  written  as 


”(^11)-^)  ^  ,,  ,,  2n(r,,)-6')  ^  2 

- ^  Gan7r7?fl(l .  1 )  or  - — — ^ GamT7ja(l .  2)  or  X'p) 


(bl  since  (X(i)  -  6)  <  —  0 j  <  ■  <  (^ir)  —  (^)  for  all  values  of  r,  llieii  the  above 

statistics  can  be  considered  as  the  order  statistic  from  a  one- parameter  exponential  pdf  EX P{a). 
Consider  the  following  transformation 


H'l 

li 

'h 

1 

Ho 

=  (”  -  1)  [(1(2)  -0)-  (x,,)  -<?)] 

H 

1 

1 

II 

fHr-l 

=  (n  -  r  -1-  2)  [(x,r-i )  -0)-  (x(,_2)  -  (9)] 

=  (n  -  r-|-2)(x(,._i)  - 

Hv 

=  (n  -  r  -f  1)  -e)-  -  6»)] 

=  (n  -  r-f  l)(x(r)  - 

knowing  that  M'l,  W^, are  independent  and  each  has  a  one-parameter  exponential  distribu¬ 
tion,  and  that 

r 

Yr  =  -t-  (n  -  r)x(^r)  -  na;(i) 

i  =  l 
r 

=  -  ^)  +  (”  -  '•)(^(rt  -6)-  n(X(i)  -  e) 

i  =  l 

r  r 

t=l  (=2 

r 

Since  each  W',  ~  EX P{(t),  then  ~  Gamma{r  —  l.cr) 

1  =  2 

i.e,.  Yr  ^  Gamma{r  —  \,(j)  or  2Y/a  ^  Gamma(r  —  1,2)  ~  X2(r- i) 

4-7  Maximum  Likelihood  Estimates  of  0  avd  a  for  the  Two-Parameter  Exponential  Distribution 

Let  A(i)  <  A'(2)  <  •  ■  <  A'(r)  be  the  order  statistic  from  a  two-parameter  exponential  distri¬ 
bution,  The  likelihood  function  in  a  random  sample  of  size  n  is  then 

’  T 

I(x(i),a:(2).  =  - - - e  l-'=i  J  (4.42) 

(??  —  r);  cr’^ 

where  9  <  .T(i)  <  •  ■  ■  <  X(r) 
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To  find  the  niaxiiniirii  likelihood  estiniator  of  a  and  0.  one  must  first  fix  cr  and  maximize  Eq  (4.43) 
w.r.t.  0  vvliere  0  vanes  over  the  range  9  <  J'o).  This  means,  0  must  he  selected  so  as  to  minimize 


+  («  -  »’)i-(r)  - 

■  =  1 

It  is  clear  that  the  minimum  is  attained  at  f?  =  arji). 

For  <T,  let  us  consider 


El 

Li=i 


di) 


9)  +  (n  -  f)(i-(r)  -  0) 


where  Yr  =  f  ^  i(,)  +  (?)  —  T-)x(r)  -  j<X(i  >  j  ,  then 


0  =  1 


fni[,(ar(,),X(2)....,X(r).  <r,  0)  =  fn  -  r)!)  ~ 


differentiating  w.r.t.  cr,  we  get 


dhiL  ^  r  Yr 

® - ~ 

dcT  a  c- 


putting 


d(nL 

da 


0  gives  <7  =  ^,  i.e.  the  M.L.E.  of  c  is  a  =  (~). 


VV' 


•l-S  The  Likelihood  Ratio  Test  (LRT)  Principle 

Let  A'l ,  AA,  ,  A’n  denote  n  independent  random  variables  having  re.spectively  the  probability 
density  function  ,(?2,  -.S,,,)  •  ’  ~  1,2,- -  .n.  The  set  that  consists  of  all  parameter  points 

(9i,  92.  ■  ■  ■  .9m)  is  denoted  by  f>,  which  is  called  the  parameter  space.  Let  u;  be  a  subset  of  the 
parameter  space  fi.  is  the  set  of  unknown  parameter  values  admissible  under  No.  then  we  wish 
to  test  the  hypothesis; 


//„  :  (9i  .Oo.  ■  ■  ■ ,  9,„)  e  u;  against  //„  :  (9i  .O2.  ■  ■ .  9,„)  ^  u.- 
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Define  the  likelihood  functions 


A*  is  determined  according  to  the  value  of  the  significance  level  of  the  test  a  according  to  the 
following  equation. 

P(A  <  y  1  is  irve)  =  a 

As  an  e.xample,  if  the  level  cf  significance  is  0.05,  then  there  is  a  5%  probability  that  the  tested 
hypothesis  will  be  rejected  when  it  i.s  actually  true.  In  this  research,  a  5%  chance  of  mistakenly 
saying  that  the  MTBF  s  of  the  samples  are  not  the  same. 

Our  objective  in  the  ne.xt  section  is  to  obtain  the  cumulative  distribution  function  of  the 
likelihood  ratio,  in  a  computational  form  so  that  the  value  of  A*  can  be  found  for  any  level  of 
significance,  any  number  of  samples,  and  any  number  of  failures. 
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4-9  DenvaUon  of  the  Likelihood  Ratio  Criterion 


Suppose  that  tliere  are  p  populations  with  the  pdf  of  tlie  i—  population  be  E X  P(9,  .er,)  and 
it  is  required  to  find  tlie  likelihood  ratio  criterion  for  testing 


//o  Oi  =  0->  =  ■  -  =  Oy  —  d  (unknown) 

=  eT'2  —  ■■=  (Tp  =  cr  (unknown) 
against  //„  otlierwise. 


Pop.  1  Pop.  i  Pop.  p 

EXP(e,,ai)  EXP(e„a,)  EXPiep.Op) 


Let  Z,  =  min(A'i(i,,  .  A'.,,  ,) 

so  Zp  -  Tnin{X  i(  i) ,  A2(  i),  •  •  • ,  A'^^)) 

Theorem  IV.  12 


Let  >,  =  ]^(A|(j)  -  A,(  1,)  +  (n,  -  r,)(A,(r.j  -  Ai(i^)  (4.43) 

;=i 

p  r 

t(j)  ^r)  +  “  ^>)(A,(r,)  -  Zp)  (4.44) 

1  =  1  ;  =  1  1=1 

<-1  I 

and  Li  =  (^  )Z,_ i  +  n,  A,(i)  —  (^  ny  )Zi  (4  4.5) 

j=i  j=i 

where  7  =  2, 3,  •  -  • 

When  [{„  IS  true,  we  will  hair 
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p 

(а) .  y^V,  Cfirmnni  R  -  ]»  rr) 

i-  1 

(б) .  V'  Gaiitina{R  —  l.a) 

p 

(c).  V  =  ^y,  +  u 

i  =  l 

where 


r 

R  =  y^r,  and  a 
1  =  1 


E‘'. 


Proof 


(a).  It  is  already  proved  that  ~  Gaimn(t(r,  —  l,cr,),  and  therefore  if  //„  is  true,  then 

p  p 

y,  ~  Gamma{Ti  —  l,tr).  Since  the  V''s  are  independent,  then  y~^y,  ~  GammaC^(ri  —  1),(t)  ~ 

1=1  1=1 


G  arnrna{R  —  p,o). 


(b ) .  Since  is  tlie  smallest  among  {A'i(j)  |  ?  =  1,  •  •  • ,  p;  j  =  1,  •  •  • ,  r,)  so,  using  the  same 

p 

result  of  (a),  we  conclude  that  V  ~  Ga?vma('^(ri)  —  1,<t)  i.e.,  V  ~  Gamina{R  —  1,<p). 

1  =  1 

(c) .  From  the  definition  of  fy’,  ,  one  can  write 

1  2 
U'2  =  (Y'^nj  )Zi  +  >i2A  2(1)  -  )Z-i 

1=1  1=1 

—  —  (^1  ^^2)^2 

^'3  =  (^1  -i-  n2)Zo  -t-  713X3(1)  -  (77i  4  772  -1-03)73 


C  1  —  (77  1  4  770  -1-  ■  ■  ■  -i"  7I^,_2)Zp_2  77;.~  I  Aj,_  1(1  )  “  (77  1  4  770  "f  ■  '  '  4  77^_  1  )Zp_  1 

I-  Ji  —  (7?  1  4  710  4  •'  4  71^,  _  1  )Zp_  I  4  77y>  A  ;i(l)~{7Jl  4  77  24  '‘471p  )Zp 

by  summation,  we  get 

r 

y"^  —  71 1  Zi  4  7Jo  A  2(  J  )  “b  ■  ■  ■  "b  77y,  Ap(  1)  —  (tIi  4  77o  4  ■  •  *  4  77y^  )Z^ 

1  =  2 

=  71  ]  (Zi  —  Zp  )  4  77  o(  A  2(  I  )  —  Zp  )  4  ■  ■  ■  -b  77p  (  A  p(  1 )  —  Z^,  ) 

r  r 

=  n,(A'i(, ,  -  +  y^T(,(A',,,,  -  Zp)  =  y^n.lA',,!,  -  Zp)  (4.46) 

1=2  »=1 
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Kq  (1  ‘14)  for  I'  can  be  written  as 


I' 


t  '  t  t 

-  )  "■  XZ^”*  ~  ^v)(A,(r,)  - 


t=i j=i 
V 


t  =  l 


“  XZ XZ^"^'*(j^ " ■*" XZ^*'*  “ “ '^*(1) 

t=l  j= 1  i  =  l 

r  r,  r 

~  XZ  XZ^'^*(ji  ”  -^*(1))  XZ^”*  “  ~  '^*(1)) 

1=1 J=1  1=1 

f  r,  P 

+  ^^(A,{ij  -  Zp)  +  ^(n,  -  '■i)(A\(i)  -  Zp) 

.=1 ;=I 

=  Evi  +  u 


1=1 


where  V,  is  as  given  in  (4.43),  and 


P  r,  p 

tt  =  ^^(A,(i)  —  Zp)  ^^(n,- —  rj)(A,(])  —  .?p) 

i  =  l  ;=1  1=1 

p  p  p 

=  ^2  '■i('^'i(l)  “  ■^p)  ■*■  “■  ■^p)  ~  ’'i{'^i(l  )  “  ^P 

1=1  1=1  1=1  , 

P 

—  'y 1  ( '^  1  ( 1 )  ~  ^p) 

i=l 


p 

which  according  to  Eq  (4.46)  equals  ')^Ui 

i~7 


r  p 

i.e.  V  =  '22  Yi  +  u  wliere  u  =  '22 

i=l  1=2 

Theorem  IV. 13  If  Hg  i.s  {rue,  i  hen  u  ~  Gamma(p  —  l.cr). 


Proof 

Hogg  and  Tanis  [3.5:439],  proved  that  tq  ~  Gaimna{\,a)  and  since  they 
then  Ih  +  U3  +  ■  ■  +  Gp  ~  Gamma{p  —  1.(t),  and  therefore  u  ~  Ga7nma{p  — 


1(1)  Zp) 


(4.47) 


) 


(4.48) 


are  independent, 
I, a). 
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The  last  t  wo  theorems  will  be  used  again  in  the  next  chapter  for  the  derivation  of  the  h~ 


moment  of  the  likelihood  ratio  criterion  A. 


For  the  derivation  of  the  likelihood  ratio  criterion,  remember  that  during  the  discussion  about 
the  Maximum  Likelihood  Estimates,  the  M.L.E.  of  was  A'i(i)  and  that  of  a,  was  ( where 


The  likelihood  function  of  A’i(i),  •  ■  ■  ,Xp^r^)  is 


p  1  -i-  ~  -  0,) 


r=i 


^  r?  ' 

T— r  fit  • 


where  k  =  H  - - 

r=i  (">•  - 


Under  the  null  hypothesis  Ho 


Ox  —  On  —  ■  ■  ■  =  Op  —  0 ,  and  <ri  =  cr2  =  •  •  •  =  Cp  =  cr 


so,  the  likelihood  function  can  be  written  as 


r  [^(-^'<0)  -  -  »’.)(A'„,.) -(?) 

.  A'p(,^,:0,;(7.)  =  e 

i=i 

1  EDA'.o)-(?)  +  ^(n.-r.)(A'.(,)-e) 


=  k—e  l.>=>J  =  i 

<7« 


J(4.49) 


The  M.L.E.  of  ??  is  ,Zp  =  min({r,(j  j  |  i  =  1 , 2,  •  -  • , p;  ;  =  1, 2,  ■  ■  • ,  r,}  ). 


Substituting  in  Jiq  (4.49)  u.sing  (4.44).  we  get 


L(X 


K  1)'  ■ 


..v 


r^’-f ) 


:0,\(r.)  =  k 


-I  ^  > 


(4.50) 


Tlie  M.L.E.  of  a  is  llien  a  —  so 


•  e  I'Vw) 


-R 


(4.51) 


when  Oi  and  <r,  are  unrestricted,  the  M.L.E.  of  9i  is  A'i(i)  and  the  M.L.E.  of  a,  is  (^)  so 


P  j 


b=i 


.tfoi)'- 

= 

P 

‘H 

t  =  l 

II 

t=i 

('■.)^')  , 

(Y.y 

(4.52) 

.52),  the  likelihood  ratio  is  given 

by 

^  niaxs,,<T,€//„  E(Ai(i). 

ITlclX^i  (7iunre.-((rTC(ed  ^(A 

D’  ■ 

■  ■  1  Aj,( 

_  k  ■  ^  €~^  _ 

‘■■(nJt)'-" 

r 

n( 

t  =  l 

vn 


no-)" 


1=1 


flOi)'' 


]!(>■.)'■  +  n(r,r 


(4.53) 
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’ THE  EXACT  DISTRIBI  TIOX  OF  THE  TEST  STATISTIC 


For  our  approach  of  selecting  tlie  proper  software  reliability  model,  a  test  statistic  is  needed. 
This  statistic  will  be  u.sed  for  testing,  whether  there  are  significant  difierences  among  various  sets 
oi  software  failure  data.  It  has  been  taken  into  account  tliat  the  underlying  distribution  is  a 
two-parameter  exponential  with  type  II  censoring,  and  the  failure  data  sets  are  of  unequal  sizes. 
Nagarsenker  and  Nagarsenker  [70]  obtained  the  exact  distribution  of  Likelihood  Ratio  Test  (LRT) 
for  testing  the  equality  of  two  or  more  exponential  distributions  using,  equal  uncensored  sets  of 
failure  data.  For  the  erpiality  of  one-parameter  exponential  distributions  see  Cole  and  others  [39]. 

In  this  chapter,  the  exact  distribution  of  the  Likelihood  Ratio  Test  (LRT),  based  on  unequal 
type  II  censored  sets  of  failure  data,  is  obtained  for  the  first  time,  in  a  computational  form. 


5.1  Assumptions 

1.  p  independent,  type  II  censored  sets  of  failure  data  arc  available,  each  has  a  two-parameter 
exponential  distribution  given  by 


where  i  -  1.2,  is  a  subscript  denotii.g  data  set 

location  parameter  and  cr,  is  the  .scale  parameter, 

2.  Each  set  has  an  unequal  number  of  observations. 


X  >  0,,  (7,  >  0 

othei'W'ise 

I  .  }>  is  the  number  of  data  sets,  0,  is  the 


The  LRT  for  testing  the  hypothesis 


Ho  0]  =  Pj  —  ■■■  =  Op  and  (t,  =  (to  =  -  ■  ■  =  cTj,  (.5,2) 


ag.ainst  the  general  alternatives  batsed  on  the  ordered  sets  of  data  where  r,  <  n,  was  given  in  the 


previous  chapter  by 


where 


no-.r 

ni'-.i'- 


i>‘  +  EV')« 

t=l 


niv.r 

T  =  1 _ 


(5.3) 


Ho 


A 


R 


Yi 


rii 


=  Null  Ilyiiothesis 

=  likelihood  ratio 

=  size  of  censored  sample  i;  1  <  fi  < 
r 

=  ^r,  ,  total  number  of  failures 

1  =  1 

r, 

;  =  i 

=  sample  size 

P  r,  r 

—  'y  \'y  ~  Zp)  +  y  (n,-  —  »’,-)(zj(r.)  ~  Zp) 

1=1; =1  t=l 

=  A'm),  A';)  1 ■  I  Ap(i )) 


5.2  Derivation  of  the  /i—  Moment  of  A 

To  get  the  h—  moment  of  A,  we  use  the  method  described  by  Wilks  [90;39l],  and  the  fact 
that  under  Ho  : 


0^=0-,-  -~0j,=0  (u.d) 

k.  O’]  =  (72  =  •  ■  ■  =  (Tp  =  (7  (5o) 

and  that  Y,  ~  Caninw{r,  —  1,  rr),  and  ii  ~  Garmria{p  —  1,(7)  as  given  in  the  previous  chajiter. 

r 

A’otc;  From  Hogg  and  Taiiis  [35:439],  Lf  and  V,  are  independent  for  each  i,  and  so  ttritl 

u  =  y  are  also  indepcndciil . 

1=2 
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Theorem  V.l  Ld  Y,  ~  Gammu{a, ,  ii).  i  =  1.1',  •  ■  avd  H’  ~  Caiiuria{k ,  B).  Fvriher. 

y 

assume  that  ^  V.  and  H'  are  7ndepeiide}il,  Iheii  the  /(—  momevi  of 


no.r 

1  =  1 _ 

(j2  n  + 


where  I'i  >  0  are  consianis  and  /?  =  rj  +  +  •  •  •  +  is  given  by 


r(£a.  +  ^) 

£(y'.)^  _ri3i - 

Qi  k  -F  R  h  ) 


1^  r(r,/i  +  &,) 

r(a..) 


Proof 


Consider  the  function  f{0)  where 


m  =  E  e  •=' 


Following  the  method  of  Wilks  [90:391],  the  /i— moment  of  V  is 


=  -Hr 


»(«■+  Ev.)r 

f(fl)  ^  E  e  «=1 


which  can  be  expressed  as 


.3-3 


rCC  /-OC  /*CV-  t 

-I  /  ■  / 

v'ii'>o  -/yi>0  ''y,>0  i 


»i  »  +  ^  y, ) 

(  '  =  '  finx  .y2.  ■  ■  ■ ,  !lp.u’)rly\(li)-i  ■  ■  dyyd\i{:>.\i)) 


where  f{yi,y'>,  -  -,  »'’)  *s  tlie  joint  pdf  of  > j  ,  Vt,  •  ■  • .  V',,  and  IV. 

Since  V’/s  and  W  are  independent  ,  then  we  have 


/(?yi , ?y2,  •  •  ■ , ?/p,  w)  =  f{y\ )  ■  ■  ■  f(yp)  ■  /(tf) 


(5.11) 


furtlier 


/(y.)  =  Gam7na{a,,/3)  =  'e 


(5.12) 


and  similarly 


The  joint  pdf  f(yi ,  t/2)  •  •  •  tVp,  «')  can  be  e.xpressed  a-s 


fl— L_  ^ 


«i  -1  j-y./,!? 


(5.14) 


substituting  for  /((?),  we  get 


/•CC  ^OO  rCC  P 

(  I  ■■  niv.)''* 


ig  '‘d^dyxdy-j- 


■  dypdw 


- ^ - j, -  r 


t  =  1  !  =  1 


,=  1  •'!'■>»  ^ 


(5.15) 
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Taking  into  account  tliat  /  x’  c^'^ctx  - 

Jci 


r(;<+i) 

ot‘+' 


,  the  last  e<)Liat.ioii  can  he  written  as 


no)  = 


t' 

Tim..) 

1  =  1 


r(t)  T-r  r{o,  +  Tih) 

i  _  11  71 


1 


)^‘r(<:)  fJi 


fjr(ft. +  ri/t)  Y^Qi  +  Rh 

— /?.=1 


(1-00)'^  P 

p  y  Q  t 


E“. 


))*r(t))3.=i  nn...)  (!-(<«) 


t=l 


i=l 


/? 


fth 


yr  r(0|  +  r,/l) 

11 

^a.  4 /2/i  + t ’  =  * 

(l-/?0)'=>  . 

p 

P  n  a.  At  +  .R/' +  *:) 

=  A'(l  -  /?<?)-“ 


where 


K  =  /?«"  ]][ 


R/i  TT 


1  =  1 


r(a,) 


and  o  =  (^o,  +  Rh  +  k) 


>  =  i 


differentiating, we  get 


(R 

dO^ 


■f(0) 


(IR 


=  A'Q(a  4  1)(q  +  2)  --(q  +  5  -  1),5^(1  - 

r(a) 


At  6'  =  0. 


d0‘ 


_  '  r(o'+ ji)  ijs 

~  ‘  r ( o )  '■ 


!.e. 


(5.16) 


(5.17) 


(5.18) 


<?=o 


dtV 


= 


e=o 


rta*  +  r,//) 


lH 


r( 


N  Of  -f  fih  k  -\-  6) 


1=1 


;• 

n  ^  ^  o,  +  Rh  +  i' ) 
i=l 


-0-' 


(5.19) 


Putting  s  =  —Rh,  we  have 


d’m 


de> 


jHh 


4  =  0 

s  =  -Rh 


„  T  nVoi  +  /?/)  +  A- -/?/() 

r{a.+r./,)T  ^ 


S 

r(^«.  +  fc) 


1  =  1 


■Rh 


r(£^a,  + 


1=1 


t'.e.  E{y 


n 


r(Q:,  +  r,/l) 


A  r(ai) 

r(^Qi  +  Rh  +  k)  ■=* 


(5.20) 


Theorem  V.2  Under  the  null  hypoikesis  the  h~  momeni  of  A  defined  tn  (5.3)  ts  gtven  by 


£(a'‘) 


R'^>'r{R-\)  ^  _,.,r(r.(l  +  /i)-l) 

r{R(i-^ii)-i)^_Y'  r(7’,-i)  ' 


(5.21) 


Proof 


In  the  previous  chapter,  we  have  seen  that  A  can  be  written  as 


A  = 


(5.22) 


and  taking  into  consideration  tliat  V)  ~  Gajmna(r,  —  1,  cr),  and  u  ~  Gamnifdp—  1 .  cr)  and  applying 
Theorem  (\  .1).  we  have 


A' 


RRh 


no;)'' 


J 


(5.2,3) 
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Tlierefore 


nc.)'- 


no.r 

t  =  l _ 


_ ih _ is] _ fr 

/  ;.  X  h  P  il 


r(r,/)  +  r,  -  i; 

r(r.  -  1) 


R^^r(R-p  +  p-\)fjr(r,{h  +  i)-i)  , 

r(R-p  +  p-l  +  Rh)f-J^  r(r,  -1) 

_,.;.r(r.(i  +  /i)-  1) 
r(R(i  +  /t)- 1)  r(ri-  i) 


(5.24) 


Having  defined  the  test  statistic  and  its  h—  mon.ent,  it  is  time  now  to  know  tlie  probability 
distribution  for  its  values,  and  have  the  cumulative  distribution  function  from  which  the  expected 
value  of  the  statistic  for  a  given  probability  can  be  calculated.  In  order  to  do  that,  the  Mellin 
Inverse  Transform  will  be  used  to  obtain  the  probability  distribution  from  tfie  moment  generating 
function  which  already  has  been  derived.  In  order  to  obtain  a  computable  form  of  the  cumulative 
distribution  function  of  the  statist  ic,  the  asymptotic  expansion  of  the  Gamma  function  will  be  used. 
Before  proceeding,  the  following  results  will  be  needed:  Gamma  Eipaiiswn: 

The  following  e.xpansion  for  the  natural  logarithm  of  the  Gamma  function  holds  [5:312] 


/riffr  +  /()  =  frj(27r)^  +  (x  +  /i 


2  ^  r(7-+lx'- 


+  Rm(^) 


(5.25) 


where  /G,(x)  is  the  remainder,  such  that  |/im(x)|  <  for  some  constant  G  independent  of  i. 
and  Br(h)  is  the  Bernoulli  Polynomial  of  degree  r  and  order  unity  given  by  the  following  relation 


Tlie  first  t  hree  PolyiioiiiiaLs  arc  (r):;{12] 


Hiih)  = 

//  -  - 
2 

(5.27) 

B^ih)  = 

/,-  ~h  +  - 
6 

(5.28) 

B-Ali)  = 

(5.29) 

Inverse  McUvi  Transform: 

If  6{h)  —  E{x^),  tfieti  the  pdf  of  z-  >  0  is  the  inverse  Mellin  Transform  given  by  [88] 


1  r'°° 

f(x)  =  —  /  x~‘'~'^4>(h)dh 

J —too 


/(t)  is  <?(<)  if  tlie  function  f{t)  is  bounded  by  some  constant  multiple  of  1  for  large  t.  Nair  & 
Norlunds  Result  [72], [74]: 

If  o(/i)  =  I  I  is  bounded;  then  <p{h)  can  be  expanded  as  a  factorial 

series  in  the  form 

^  ^  i  ^  "h  I  "f"  fl) 

x=0  '  ' 

where  a  >  0  is  an  arbitrary  constant  chosen  such  that  /?]  =  0  and  the  coefficients  /J,  are  obtained 
u.sing  the  following  recurrence  relations  from  [71:363] 


;=0 


=  t  =  L2,3,-- 

r 

—  ^  ^  ,r  —  ^1,0=1 

h  =  l 

^  \  /  to  f  D  / 


r(r  -h  ] ) 


{Br+i{a)  -  Br+i{a  +  +  0] 


(5.32) 

(5.33) 

(5.34) 
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Beta  Fuiicltoii: 


The  Beta  fiinclioii  of  w  and  ;  is  defined  as 


B(w,z) 


B{=,w)=  r 

Jo 


wliich  is  related  to  the  Gamma  function  by 


B(z,w) 


r(r)r(te) 

r(z  +  w) 


(5.35) 


(5.36) 


Incomplete  Beta  Function: 

The  Incomplete  Beta  Function  Ii(a,b)  is  defined  by 

/,(a.6)= r  <“-•(! {a,b>0)  (5.37) 

B{a.b)  Jo 


5.3  The  Null  Distribution  of 

Let  L  =  A’’^^ ,  then  from  (5.24)  we  liave 


E{L 


'm  - 


r  r 


r(R  +  ph  -  1) 


■'■’■‘"'nr, +(§)''* -1) 

n 


where 


r{R-  1) 

r 

nrc'-. -1) 


.Applying  the  Inverse  Mellin  Transform  [88]  to  E(L^),  the  pdf  of  L  is 


(5,38) 


(5.39) 


m  =  /'■ 


n  r[(pm  +  p/,  +  6)fc.  -  1]] 

■  =  i _ 

r(pm  +  6  +  ph  —  1 ) 


(5.40) 
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where 


6  =  adjustment  or  convergence  factor 

pJH  =  R  — 


ki  —  i\/R\  k'l  -|-  k 

2  +  ■  ■  ■  ^  A'p  —  1 

define 

t  =  m  +  li 

; i.e.  /i  f  —  m 

(5.41) 

From  (5. 40), (5. 41),  we  get 

^  ^m+»oo 

Jm  — too 

(5.42) 

where 

p 

Ki  =  AT‘-^  )-'’"•*• 

isl 

(5.43) 

fl{{kir^“‘'n(pt  +  8)k,-i)] 

and 

“  r(p<  +  ^-i) 

(5.44) 

Using  the  asymptotic  expansion  for  the  logarithm  of  the  Gamma  function  [5 

':pp.312]  then- 

PU)  =  A'2  [l  +  ^^-1-  ^  +  ...] 

(5.45) 

wl 

here  RA,  =  (2a-)' ^ ' 

(5.46) 

and  i;  =  3(;;  —  l)/2 

(5.47) 

Tlte  coefficients  q,.  are  reciirsi\ely  determined  using  the  following  relations 


Vr 

Ar 


(5.-48) 

(5.49) 
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E(j  (5.45)  shows  that 


m/K-.  =  (?(<“') 


(5.50) 


witli  real  part  of  (  tending  to  oo;  has  therefore  tlie  following  exact  representation  as  a  factorial 


series  [72,  74] 


OO 

(j){t )  =  Kn  ^  Ri 

i=0 


r(t+a) 

r(t  +  a  +  t;  +  j) 


,  ^t)  =  1 


(5.51) 


where  a  is  a  convergence  factor  chosen  such  that  /?j  =  0,  and  the  /?'s  arc  obtained  using  (5.32) 
Using  (5.51)  in  (5.42),  the  pdf  of  L  is  [71] 


f(£)  =  Ks-'£R, 


a-1/1  _ 


*  =  0 


r(u  +  i) 


where  A'a  =  (2ir)^(p)-*'r(ft  -  1)[]  /T(Rki  -  1)] 

i 

In  Eq  (5.49),  choose  6  such  that  Ai  =  0,  then 


(5.52) 


(5.53) 


6=^[^(/:.r‘-l]/(p-l) 


18 


(5.54) 


In  Eq  (5.51).  choose  a  such  that  Ri  =  0,  then 


a  =  (1.0  -  v)/2.0 


(5.55) 


From  (5.52),  the  cdf  of  L  is 


F{n  = 


=  Rz 


p{L<n  =  md( 

-to 

.-n  do 


where  A, 


r(v  +  i) 

Kz  ^  A,  •  Ii{7v  A  a,v  +  i) 

1=0 

/?i[r(m  +  a)/r(Tn  +  a  +  v  +  i)] 


df 


(5.56) 

(5.57) 
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VI.  THE  .ASYMPTOTIC  DlSTRIBHTfON  OF  THE  TEST  STATISTIC 


When  the  exact  method  for  comparing  difl'erent  sets  of  software  failure  data  was  applied, 
some  sets  were  very  large  and  sometimes  exceeded  eight  hundred  failure  times.  The  calculations 
for  these  large  sets  were  very  time  consuming,  which  made  it  necessary  to  think  of  another  efficient 
method  for  calculating  the  cumulative  density  function  (cdf)  with  accuracy  approaching  that  of  the 
exact  method.  In  this  chapter,  a  useful  asymptotic  expansion  of  the  distribution  is  obtained  up  to 
the  order  of  where  R  is  the  total  number  of  failures.  The  second  term  in  this  expansion  is  of 

the  order  of  and  so  can  be  used  to  obtain  accurate  approximations  to  the  percentage  points 

of  the  test  statistic.  In  fact,  the  first  term  alone,  which  is  a  single  beta  distribution,  provides  a 
powerful  approximation  even  for  moderately  large  values  of  R.  Of  course,  for  a  small  number  of 
total  failures  (  less  than  20  failures),  one  has  to  use  the  exact  distribution  obtained  in  the  previous 
chapter. 
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Tlie  followinj;  lemma  will  help  in  siin|ilifying  t  he  derivation  of  the  asymptotic  distrihutioii 


Lemma  VI. 1  The  following  erpnnsion  for  the  ratio  of  two  Gamma  functions  holds  [69:359] 


r(m  464a) 

r(m  4  h  4  0  4  14  i) 

where  c,,r 

r(r  4  1 ) 

CM  ,  ^ 
m  m- 


where  c,,r  =  — — — [iJr+i  («)  -  £,  +i(a  +  t' +  0] 

r(r  +  I ) 

Taking  the  natural  logarithm  of  I\{ni)  given  in  (6.4),  we  get 

p 

£nK(ni)  =  (nr{pm  +  6  —  1)  —  ^nr(pj7iA:,'  +  6ki  —  1) 

i=l 

=  [^6i(2jr) +  (pm  +  ^- 1  -  ^)£n(pm)  -  (pm) 


-Y. 

^  1  1 

-  ^[-6!(2ir)  +  {pmki  +  6ki  -  1  -  -)Cn{pmk^)  -  {pmk^) 

i  =  l 

~  i — TTTT - rT~  +  i?m+i(pni^-,) 

^  r(r4  l)(p7n*,)’^ 

1  3 

=  -fn(2-)  +  prnCn(pin)  ->rbtn(pm)  ~  -Cnfpm)  —  {pm) 

^  (— l)’‘5,-+i(iS  —  1)  p 

-  E  V(r4l)(p77.r~  ^  ~  2 

3  ^  3 

-  Y^iprnk,  4  6k,  —  -)[v{pm)  -  '^(pmki  4  6ki  -  -)fnk, 

1=1  1=1 
.  V'l  I  \  .  ^  (— ~  1)  ,  n>  /  I  \ 

4  >  pmA;.)  4  2^  >  ,  — - — — — - — — - h  R,„+i{pmki) 

7^1  ’'(t- 4  l)(p7iiA-,  )’^ 

=  ^  ^  ^  ^—Cn{'2-)  4  pm{n{prn)  4  6Cn{p7n)  —  '-Cn{pm)  —  (pm) 

"  E  ^  ^  IWl  V  ^'  +  firr^+iipm)  -  pmCn[pm)  -  6Cn(pm) 

“  r(r  4  I)(p7f7)’^ 

2p  ^  2 

+  -^(n{pin)  —  '^^[{pmki  +6ki  -  -  ){nk,  4  prn 
i  =  l 

,  (  — O'^-Or+I  (^i'l  ~  1)  ,  r>  /  1  \ 


4  1  )(rmk,) 


i.e. 


in}\{m) 


4  ^-^  +  0(117’-') 

m’ 


where  flr  = 


-ir  Br+i(6k.-l) 


r(r  +  1);. 


7'± 

Li=i 


Br+l{6  -  1)  =  ->lr 


^Ji/\  (m)  can  be  expressed  as 


£n/\(m)  =  Cn  (2t)~^ (p7n)7^''  1 1  jQ  ^ 

1  =  1 

so  K{m)  =  ^ 

1  =  1 

=  f]  +  Zl  +  4  +  ...' 

m  m- 

»  — t  ^  j 


(6.10) 


The  coefficients  Tr  are  recursively  determined  from  the  following  relation 


1 

=  -^^ka^Tr-k  -To  = 


(6.11) 


Substituting  in  (6.3),  we  get 


=  (2.)^(pm)>ni-r''’ 


-(j-mt. +  .)*,-§)  ,  ^2 

I  1  4  “T  r,  “1 

m  m- 


■”n(^  ■^'’*•”5(2-)''^) 


,,  Ti  n 
,n'  1  +  -L  -f  ^  - 

T7l  111- 


(6.12) 


(6.13) 


where  v  =  -(p  —  1) 


(6.14) 
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6.S 


Asyviptotic  Kxpan stov  aj  Ihf  Eiuct  Distrihulion 


Choosing  t  such  that  1\  =  0,  makes  a,  =  0  ami  Yi-  —  u-,.  tlieii  snhslituting  in  (h  i),  we  get 


F{1)  =  /n*'  1 


T-j  ,  n  1  !'(»<  +  «) 

+  — t;  •+  — :7  I  ^  R,  —  77 

nr  jtt’  <  1  (rii  +  fl  +  i;  +  .  ) 


+  a.  i:  +  i) 


(6.15) 


Using  lemma  (^'l.l)  for 


r(in  +  a) 
r(m  +  fl  +  r  4  i) ' 


/-'(f)  will  be 


=  m'  1  4 


lL+lL  +  ..]y  1 14^4^^- 


ni  m- 


lt{n)  +  a,v  +  i) 

Ti  T.  1 


Jo  Jo  \  "V  ^  1  C|  1  C|  2 

1  H - t;  4  — j  4  •  •  •  2^  i  “* - T+T  - ria>' 

m-  J.1'’  ^ — '  m*  jn'  +  '  -  -  r77'+- 


■I({m  4  fl,  t’  4  t) 

r,  .  T. 


=  [1  4  ^  4  •  -JK/lo  +  —  -f  •  •)/f  (m  4  fl.  t>) 

m-  uF  111  111- 

4  /2i( - h  — 77  4  ■  •  ■) /((m  4  n .  t'  4  1 ) 

m  nt- 

4/?o(  — -  4  — ^  4  •  '  ■)/<'(tn  4  fl,t'4  2) 
rr?  -  nn’ 

=  R(ile{iii  4  fl.  r)  4  —  [co  I  //(»"  4  o.  f)  4  Rilc(iii  4  fl.  f  4  1 )] 
in 

4-^[co  •>/((?«  4  fl,  tO  +  +  o-  f  ■+  1) 

Vf 

4//2/r(rfl  4  fl,  V  4  2)  4  T'2 //o/f(^fl  fl)  ^')]  "h  C(tn  ^) 


(6.16) 


•Since  //p  =  1.  fl  is  chosen  such  that  /fj  =  0.  and  f  is  cho.sen  such  that 
Ti  =  fli  =  0,  then  from  the  recurrence  relations  co.i  =  0,  and  F{()  will  be 


I[{m  4  fl.  f)  4  — ^-ffo  ihim  4  fl.  v)  4  R'^Ii{iv  4  fl.  n  4  2) 
m- 

+  T'2l((m  4  fl.  t’)]  4  0(111'^) 


4  fl,  i’)  4  — ^[(c,)  2  +  J2)/r(7fl  +  fl- 1  )  4  R-ihiin  4  o,  r'  4  2)j 
111- 


-0{i,i^) 


(6.17) 


7’;  —  Cfi  lliPii  t(ie  asymptotic  distribution  of  the  test  statistic  is 


111  practice,  it  is  found  that  this  asymptotic  distribution  is  good  wlien  the  number  of  failures  in  the 
set  is  greater  titan  twenty. 
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VII.  orsic.x  .A.\D  .APPLIC.\TION  OF  THE  PMS  ENVIRONMEST 


In  tlie  preceding  two  cliaplers,  the  inallieinatical  solution  for  the  proposed  method  for  solving 
tlie  problem  of  proper  model  selection  has  been  developed.  This  is  not  the  end  in  itself.  This 
mathematical  solution  should  be  transformed  into  a  useful  algorithm  for  the  practical  ajiplicat ion 
of  this  mathematical  solution.  The  algorithm  is  then  coded,  using  the  appropriate  programming 
language,  into  an  environment.  In  this  way,  the  solution  can  even  be  modified  to  solve  other  similar 
problems  that  may  even  exist  in  other  fields.  The  transformation  of  a  mathematical  solution  of 
a  problem  into  an  environment  is  the  link  between  two  sides.  The  mathematical  solution  of  the 
problem,  the  design  of  an  environment,  and  coding  of  this  design,  using  an  appropriate  programming 
language,  are  one  side.  The  other  side  is  the  user  wlio  will  use  the  environment,  and  pro%’ide  the 
feed  back  about  the  tool  to  the  designer  and  the  programmer. 

7.1  Definition  of  the  Proper  Model  Selection  (PMS)  Environment 

The  first  question  to  be  asked  is  what  the  Proper  Model  Selection  (PMS)  environment  can 
do  and  how.  As  the  name  indicates,  it  helps  in  selecting  the  proper  software  reliability  model  for  a 
given  set  of  data.  This  environment  is  very  simple  and  user-friendly.  The  user  will  keen  in  mind  the 
accuracy  of  calculations  needed  (exact  or  asymptotic),  depending  on  the  computer  time  available 
and  the  size  of  the  failure  data  on  hand  (2isymptotic  method  is  preferable  for  failure  sets  more  than 
2b  in  size).  All  that  the  u.ser  needs  to  know  after  that  is  whether  the  data  he  or  she  has,  are  in  the 
form  of  failure  times  or  times  between  failures  and  the  name  of  the  file  where  the  data  are  stored. 
The  environment  will  lake  these  data  and  estimate  the  sample  size  (which  is  not  known  in  case  of 
software  failures).  The  maximum  likelihood  method  is  used  to  estimate  the  sample  size  as  given  in 
Appendix  B.  After  estimating  the  sample  size,  the  environment  wdll  check  whether  the  given  set  of 
data  can  be  from  an  exponential  distribution,  which  is  the  most  common  distribution  for  software 
reliability  studies.  The  method  used  for  testing  the  exponentiality  of  software  failure  sets  is  the 
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one  referred  to  as  the  6’  tf  st.  'I  his  method  is  based  on  the  so-called  Giiii  statistic  and  is  discussed 


by  Ciail  and  Gastwirth  [‘J9].  The  test  has  j!,ood  power  against  some  other  alternatives  [-ITshif.j 
specially  with  type  II  ccjisored  data.  If  the  data  did  not  provide  evidence  against  exponentiality. 
then  the  PMS  will  calculate  the  likelihood  ratio  test  criterion  for  the  given  set  and  compare  it  with 
the  percentage  points  at  different  significance  levels  to  determine  if  the  given  set  of  data  can  he 
considered  equal  to  one  or  more  of  the  software  failure  sets  given  by  Musa  [64]  (refered  to  as  DACS 
failure  sets),  or  by  Littlewood  [52],  A  table  will  be  produced  by  the  environment,  telling  whether 
the  set  under  test  is  equal  to  one  or  tiiore  of  the  other  sets,  and  the  maximum  significance  level  at 
which  they  can  be  considered  erjual.  If  the  given  set  of  data  provide  evidence  against  exponentiality. 
then  extra  data  may  be  needed. 

Along  with  the  PMS,  a  table  generation  environment  is  developed  to  give  the  percentile  points 
at  different  significance  levels  for  different  failure  sizes,  and  at  different  numbers  of  samples. 

7.S  Design  of  the  PMS 

The  Function-Oriented  Design  method  has  been  used  for  the  design  of  the  environment  as 
shown  in  Fig  (7.1).  This  method  makes  use  of  the  data  flow  diagrams  and  the  structure  charts 
for  the  environment.  The  Proper  Model  Selection  environment  (PMS),  is  designed  to  work  with 
Personal  Computers  using  MS  DOS  operating  system.  This  will  widen  the  base  of  users  of  the 
environment  and  will  enhance  the  tool  itself,  l\v  adding  more  data  files  to  existing  ones.  The  PMS 
can  be  easily  modified  to  incorporate  new  mathematical  methods,  or  to  improve  those  already  in 
use.  For  the  implementation  of  the  design,  the  C  language  is  chosen  as  the  programming  language. 
Code  listings  for  implementing  the  design  of  the  PMS  environment,  shown  in  Fig  (T.l)  are  given  in 
.Ap[>endix  C. 


Sample-rj  |  1 1  lrt,Samples_No 


)le-ri 

R 


exact  ,ri 


V - )  - J  Musa’s 

o  ocDE“>r 


Compute_Percentile() 


P-»K) 


R  I  f  Newton() 


ln-Gamma()[ 


Betacf()  I 


Creale.Cir() 


Bernolli 


Betacf() 


Polynomials 


Ri.CoefO 


Create.DirO 


q_Coef() 


Bern.PolyO 


Ar.CoefO 


Bernolli 

Numbers 


Bern.NumO 


comp 


com() 


Figure  7.1,  A  Structure  Chart  for  the  PMS  Environment 


7.5  A  Practical  Example  for  Using  ike  PMS  Environment 


To  demonstrate  how  to  use  the  PMS  environment,  we  liave  chosen  Set  2  of  the  DACS  software 
failure  data  supplied  by  Musa  [64]  as  an  example  for  the  demonstration.  This  set  of  data  is  stored 
in  the  form  of  times  between  failures  as  given  in  table  (7.1). 


191 

50 

6900 

2519 

222 

660 

3300 

6890 

280 

1507 

1510 

3348 

290 

625 

195 

2750 

290 

912 

1956 

6675 

385 

638 

135 

6945 

570 

293 

661 

7899 

610 

1212 

50 

365 

612 

729 

390 

675 

900 

275 

1215 

180 

360 

2715 

4225 

800 

3551 

15600 

1210 

800 

300 

407 

3910 

9021 

Table  7.1.  Set  2  of  DACS  failure  data  in  [64] 


Assuming  that  the  set  is  stored  in  a  file  “set2.dat”,  then  the  sequence  for  running  the  envi¬ 
ronment  will  start  by  typing  the  executable  file  name  “pms”  and  continues  as  follows  : 


Enter  Type  ol  Calculations  Exact  (elE)  OR  Asymptotic  (a  I  A)? 
a 

asymptotic  calculations  requested 


OK  !  Now  Enter  The  Name  of  Data  File  ? 


set2 . dat 
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Enter  the  Type  of  the  Data 

Failures  Times  (f IF)  OR  Time  Between  Failures  (t|T)? 


f 

failure  times 


Supplied  Data  Provided  Evidence  Towards  Exponential ity 

Likelihood  Ratio  Test  Program 
Asymptotic  Method  for  Checking  Equality  of  Data 
and  Proper  Model  Selection 
The  Symbols  in  the  table  are  Y(es)  or  B(o) 

The  Value  Under  Yes  or  Ho  is  (L-C)  ' 

For  Equality  L  must  be  greater  them  C 

then  Table  D-2  in  APPENDIX  D  will  be  generated. 

from  the  table  the  following  information  can  be  extracted: 

1 .  Set  2  of  DACS  can  be  considered  equal  to  both  of  set  1  of  DACS  sets  [64]  and  set  2  of 
Littlewood  sets  [52]. 

2.  It  is  also  clear  that  set  2  is  closer  to  the  former  set  than  the  latter  one  [L  —  C=0.035  vs  0.017 
at  significance  level  =0.05) 

3.  The  set  can  also  be  considered  to  be  equal  to  set  17  of  DACS  sets,  but  at  a  lower  significance 
level  (0.005). 
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Tlic  question  to  he  answered  next  is: 

Which  Software  Reliability  Model  is  the  Most  Appropriate  One  to  be  Used  with  This  Set  of  Data  ? 

To  answer  this  question,  it  is  necessary  to  find  out  the  model  or  models  that  fitted  properly 
in  the  past  with  those  sets  of  data  that  proved  to  be  equal  to  the  set  under  investigation  (  i.e.  set 
1  of  DACS  sets  and  set  2  of  Littlewood  sets).  For  the  first  set,  full  Analyses  were  performed  by 
Littlewoocl  [52:184]  on  this  set  of  data,  using  the  Median  Variability,  the  Rate  Variability,  the  Braun 
Statistic,  the  u-plot,  the  y-plot,  and  the  Prequential  Likelihood  analysis.  The  results  of  these 
analyses  strongly  suggested  that  the  Littlewood  Model  (L)  [49]  and  the  Littlewood  Non  Homoge¬ 
neous  Poission  Process  Model  (LNHPP)  [1:955]  are  the  most  appropriate  ones.  This  means  that 
these  two  models  are  also  the  best  candidates  to  be  used  with  the  set  of  data  under  investigation. 
On  the  other  hand,  one  can  also  use  the  software  reliability  model  or  models  that  proved  to  be 
the  best  with  the  set  2  of  Littlewood  data  (despite  the  fact  that  it  is  less  closer  than  the  previous 
one,  as  explained  before).  Similar  analysis  done  by  Abdel-GhaJy  and  Others  [l]  suggested  that 
the  Littlewood  Model  [49],  the  Littlewood- Verrall  Model  (LV)  [55],  or  the  Keiler- Littlewood  Model 
(KL)  [41,  42]  are  the  best  models  to  fit  with  the  second  set  of  Littlewood  data,  and  accordingly, 
with  the  set  of  data  under  test.  From  the  above  discussion,  it  is  clear  also  that  the  Littlewood 
Model  [49]  fitted  both  of  the  two  sets  that  proved  to  be  equal  to  the  data  set  under  consideration. 
This  strongly  suggests  that  the  Littlewood  Model  [49]  is  the  best  one  to  be  used  with  the  set  of 
data  under  study. 

Full  Analyses  of  DACS  failure  data  and  the  two  sets  of  data  supplied  by  Littlewood  [52]  are 
given  in  APPENDIX  D. 
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A  large  number  (currently  about  100  [26:322])  of  software  reliability  models  liave  been  devel¬ 
oped  within  the  last  two  decades.  Unfortunately,  each  of  these  models  can  jiroduce  a  very  different 
answer  from  the  others  when  applied  to  predict  the  reliability  of  a  software  system.  Further,  a 
model  that  seems  to  be  the  best  for  one  set  of  data,  may  give  very  poor  results  with  other  sets. 
This  is  not  surprising,  since  the  assumptions  for  each  model  cannot  be  satisfied  in  all  situations,  '  ' 
to  the  variations  in  tlie  development  and  testing  environments  for  each  project.  The  above  prob¬ 
lems,  as  well  as  time  and  cost  constraints,  made  many  softw^are  practitioners  avoid  incorporating 
reliability  modeling  as  a  management  technique.  This  situation  makes  it  necessary  to  devote  less 
effort  for  developing  more  software  reliability  models,  and  concentrate  on  finding  tools  for  selecting 
the  proper  model  for  a  given  set  of  data. 

The  Proper  Model  Selection  (PMS)  environment  is  one  approach  for  solving  this  problem.  It 
uses  the  same  model  that  proved  to  be  the  best  for  an  equal  set  of  data  in  the  past.  It  performs 
a  test  of  equality  of  a  given  set  of  software  failures  with  each  of  the  other  sets  that  previously 
fitted  with  different  models,  to  determine  how  close  the  set  under  test  is  to  each  of  other  sets,  if 
past  predictions  of  a  software  reliability  mode!  have  been  in  close  accord  with  actual  behavior  for 
a  particular  data  set.  then  it  will  l^e  reasonable  to  use  the  same  model  with  an  equal  set  of  data. 
The  PMS  can  help  in  selecting  the  proper  reliability  model  without  evaluating  different  models, 
comparing  them,  and  then  choosing  the  best  one.  It  can  be  simply  stated  as  '‘tualthiitg  a  software 
rehabiliiy  model  to  a  given  set  of  failure  data". 

The  (PMS)  is  a  simple  and  objective  method  for  selecting  a  proper  model  for  a  given  set  of 
data.  The  main  advantage  of  this  method  is  that  one  will  make  use  of  the  previous  effort  consumed, 
when  different  models  were  applied  with  different  sets  of  dat  a,  and  when  different  techniques  were 
applied,  to  measure  the  predictive  quality  of  software  models  with  certain  sets  of  data.  Idie  PMS 
environment  will  provide  a  strong  framework,  and  a  useful  data  base  system,  which  will  result  m  the 
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user  cotifideiice  of  the  software  reliability  calculations  lie/slie  makes.  This  will  help  in  establishing 
a  software  reliability  theory  similar  to  that  of  hardware. 

Based  on  the  assumptions  stated  initially,  and  the  observations  found  during  the  development 
and  the  application  of  the  PMS  environment,  the  following  recommendations  are  proposed  for  future 
work: 

1.  Despite  the  fact  that  estimating  the  sample  size  using  the  maximum  likelihood  method  is 
straightforward,  some  failure  sets  showed  that  the  size  is  very  close  to  the  number  of  collected 
failures.  Other  methods  for  dealing  with  such  cases,  need  to  be  added  to  the  environment. 

2.  Two  sets  of  failure  data  (SETS  27,SS4  of  DAGS  failure  sets)  were  not  equal  to  any  other  sets. 
This  may  be  due  to  the  limited  number  of  sets  of  software  failure  data  used  for  comparison, 
or  more  data  may  need  to  be  collected.  The  former  case  can  be  solved  by  adding  more  failure 
sets  to  the  environment. 

3.  The  studies  for  deciding  which  model  fits  with  which  set  of  data  are  still  limited  [41,  42,  52]. 
More  studies  of  this  kind  are  needed.  This  will  make  it  possible  to  modify  the  environment 
in  the  future  to  provide  the  best  candidate  models  to  be  used  along  with  each  equal  set. 


Appendix  A.  Calculations  of  the  Adjusinitnt  Facial's 


In  this  Appendix,  the  values  of  the  convergence  factors  o  and  ^  used  in  chapters  5  and  6.  Tlie 
values  of  these  two  factor.s  are  calculated  in  the  following  two  sections 

A.]  Calcuiattou  of  6 

6  is  an  adjustment  factor  defined  such  that 

>fi=0;  (A.l) 

where 

A 

"  "  r(r+  l)p' 

The  symbols  used  in  the  equation  are 

p  the  number  of  samj^les 

ki  the  percentage  of  failures  in  sample  i 

Br{  )  Bernoulli  Polynomial  of  degree  r  and  order  unity 


tsl 


(A.2) 


taking  r  =  1 ,  we  get 


-1 


p 

1  =  1 


Br+  J  (  fki  —  ]  ) 

k. 


Knowing  that  the  second  Bernoulli  Polynomial  B^lh)  is 


/?2(/j)  =  A-  +  /)  + 


1 

G 


(A.3) 


(A.4) 
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Substituting  in  (A. 3),  we  have 


Ai  = 


'^P 

2p 

-1 

2p 

J_ 

2p 

1 


(M-,  -  -  1)+ i 


6  ^  A*, 


1=1 

r 


»=1 


-^■■’  +  3i!i  -  ^  -  3(^p+  y  y^(^,~^) 


i  =  l 


3(5(1  -p)  +  ~ 


(A.5) 


To  get  6,  we  put  Ai  =  0  so 


36(p-i)  =  '■^■ 


^  =  TlE(*^r')-i]/3(p-i) 


1=1 

p 


18 


i=l 
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A.5  Calculation  of  a 

a  is  a  convergence  factor  chosen  such  that  Ri  =  0,  and  the  coefficients  Ri  are  obtained  using 
the  following  recurrence  relations  from  [71] 


;=n 

=  9.(r  1,2,3,-  -^/Jo  =  1) 

(A.7) 

d,,.  =  ykci^k.d,,r-k/r.  (fi,o=i 

k  —  1 

(A.8) 

C  —  1 

(-l)'--l 

c,,r  =  ,  ,  (5r+i(a)  Sr+i(a  ■+ u  +  j)] 

r(r  +  1) 

(A. 9) 

where  v  =  3(p  -  l)/2  and  i/r  is  determined  using  (Jie  following  relation 


gr  =  ^  IcAtqr-k/r  .90  =  1 


k  =  t 


(A.  10^ 


the  value  of  Ri  can  be  found  front 


R\d-\,0  +  ^0^0,1  —  fli  — 


(A. 11) 


where  Ai  =  0  as  discussed  above.  If  /Zj  =0  is  desired,  then 


do,i  =  co.ido.o  =  0 


(A.12) 


this  means  co.i  =  0  i.e. 


-[52(a)  —  B2{a  +  i’  +  7’))  =  0 


(A. 13) 


Snbstitiiling  for  the  Bernoulli  Polynomials,  we  get 


i[a^  -  «  +  i  -  (a  +  1)‘  +  (o  +  1)  -  ^]  =  0 

ii  o  u 


(A, 14) 


which  reduces  to 


1*  +  2(iv  -  7;  =  0 


(A.  15) 


solving  this  equation  gives 


a  = 


(A. 16) 


A-3 


.A{)])er)dix  B.  Maximum  Liktlihood  Estimate  af  Sample  Size  n 


A(i|  <  A’(2)  <  ...  <  A'(r)  be  tlie  order  statistic  from  the  2-paraiiieter  exponential  distri¬ 
bution,  then  tlie  likelihood  function  for  a  random  sample  of  size  n  is 


-  P)  +  ("  -  -  (^))] 

Kg 

n'  1  1 

(n  -  (?)(rs  +  (n  -  r))] 


(B.l) 


wliere  s  = 


is  the  observed  value  of  the  random  variable 


c  —  (-^(O  ~ 

■  h 


(B.2) 


Noting  that  for  each  n  , we’ve  found  in  chapter  2  that  equation  (B.l)  was  maximized  by  having 


<r 

and  6 


"  +  («  - '’)a^(r)  -  ni-(i) 

Lx=i 

X(\) 


(B.3) 

(B.4) 


Denote  (B.l)  with  a  and  6  substituted  by  L{x  |  n).  Let  C(x  j  n)  be  IogZ.(r  |  n),  then  (B.l)  is 
maximized  by  the  n  satisfying 


C{x  I  n  +  1)  —  L(x  I  n)  <  0  <  C{x  (  n)  —  L{x  |  rj  —  1)  (B.5) 


Following  the  same  procedure  as  Blumenthal  [12],  equation  (B.5)  is  achieved  by  n  such  that 


D(r>)  <  s  <  D(ri  +  1 ) 


(B,6) 
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'vliere 


-  |r(l  -  [1  -  (r/n)]^’/’'))|  +  i  _ 


(B.7) 


If  there  is  an  upper  bound  m  on  the  possible  values  of  n 


,  then  the  estimator  would  be 


«m  =  min(m,  ri) 


(B.8) 
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Appendix  .  C-odi  h^tuKj 


^if^^m*^****'^****^*’^******^**  *********************  ******  * 

**  DATE:  01/16/1992  ** 

•*  VERSION;  1.0  *♦ 

♦♦  TITLE:  Main  Program  File  *♦ 

♦*  FILENAME:  pms . c  ** 

COORDINATOR;  Salah  Amin  Elewa 
♦  ♦  PROJECT.-Development  of  an  Environment  for  Software  ♦» 
**  Reliability  Model  Selection.  •• 

»♦  OPERATING  SYSTEM:  MS  DOS  version  2.0  or  higher  ** 
»♦  LANGUAGE:  Turbo  C  (2.1)  ** 

•*  FILE  PROCESSING:  Compile  and  link  with  files  prep.c** 
**  compute. c,  coefs.c,  and  prob.c,  ** 

**  CONTENTS:  1.0  main  ()  -  executive  module  •• 

**  FUNCTION:  This  file  contains  the  main  program  of  •* 

/ 

**  the  project  ** 

*♦♦**»****••*♦**♦**♦♦»•**•*•**»»******♦•****•***••**•**/ 

^include  <conio.h> 

^include  "defs.h" 


extern  void 
extern  void 
extern  void 
extern  void 
extern  void 


Get_Inf ormation(void) ; 
Estimate_n(void) ; 
Check_Exp(void) ; 
Print_Table_Header(void) ; 
Compar  e_Sets ( int) ; 
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DATE:  01/16/1991 

VERSION:  1.0 

** 

MODULE  NAME:  main 

** 

** 

MODULE  NUMBER:  1.0 

** 

** 

DESCRIPTION:  This  main  program  in  the 

environments  *♦ 

** 

PASSED  VARIABLES:  None 

RETURNS:  None 

** 

** 

HARDWARE  INPUT:  None 

HARDWARE  OUTPUT: None 

** 

MODULES  CALLED:  Get_Inf ormationO 

** 

Estimate_n() 

** 

** 

Check_Exp() 

♦  * 

Compajre_Sets  () 

CALLING  MODULES:  None 

** 

** 

AUTHOR:  Salah  Amin  Elewa 

** 

HISTORY: 

•*  1.0  Salah  Amin  Elewa  01/16/1992  *• 

original  version  /  ** 

***♦♦»*»*»**»**♦♦*»••••»♦•***•»**»»•*****••**»•**»»**••/ 


void  mainO 

{ 

int  K ; 


clrscr () ; 

Get_Infonnation() ; 

Estiniate_n()  ; 

Check_Exp() ; 

Print _Table_Header ( ) ; 
for  (K  =  1;  K  <  DATA_FILES;  K++) 
Compare_Sets(K) ; 
return; 
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**  DATE:01/25/1992  •* 

**  VERSION;  1.0  *♦ 

**  TITLE:  Failure  Data  Processor  *♦ 

•*  FILENAME:  Prep.c 

**  COORDINATOR:  Salah  Amin  Eleua  *♦ 

•  **  PROJECT: Development  of  an  Environment  for  Softusire 
♦♦  Reliability  Model  Selection.  ** 

**  OPERATING  SYSTEM:  MS  DOS  version  2.3  or  higher  *♦ 

*♦  LANGUAGE:  Turbo  C  (2.1)  •* 

♦♦  FILE  PROCESSING:  Compile  and  link  with  files  pms.c  •* 

♦♦  compute. c,  coefs.c,  and  prob.c.  •* 

CONTENTS:  .  .  ** 

♦♦  1.1.1  -  Get_Information()  *♦ 

**  1.1.2  -  Estiraate.nO  *♦ 

1.1.3  -  Check_Exp()  ** 

**  1.1.4  -  DO  *• 

*•  1.1. S  -  Print_Table_Header()  •• 

•*  FUNCTION;  The  modules  in  this  file  get  information  •* 
•*  about  calculation  method,  how  data  are  stored  •» 

**  (failure  times  or  times  between  failures) ,  »* 

♦*  estimate  sample  size,  check  exponentiality  of  *• 

*♦  failure  data  and  print  table  header.  ** 

***************«*****•**»*****************•******•***•••/ 
^include  <stdio.h> 

^include  <conio.h> 
tinclude  <math.h> 

#include  <ctype.h> 

^include  <stdlib.h> 

^include  "defs.h" 
extern  boolean  exact; 


void  Get_Inf ormation( void) ; 
void  Print_Table_Header(void) ; 
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void  Estimate_n(void) ; 
void  Check_Exp( void)  ; 
void  Print_Table_Header(void) ; 
double  D(int,  int); 


static  int 
static  double 
static  FILE 
FILE 


n,  rr ; 

t [MAX.FAILURES] ; 
♦fplOO; 

•  fp5; 
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♦*  DATE;  01/25/1992  •* 

**  VERSION:  1.0  •* 

**  MODULE  NAME:  Get_Inf ormationO  *• 

••  MODULE  NUMBER:  1.1.1  *• 

*♦  DESCRIPTION:  This  module  is  used  for  obtaining  inf-** 

■ **  ormation  about  the  required  accuracy  of  calcu-* 

**  lations,  the  naune  of  the  file  containing  ** 

**  failure  data  and  the  form  of  failure  data.  It** 

••  stores  failure  data  as  failure  times  if  it  was* 

**  stored  as  time  between  failures.  ** 

**  PASSED  VARIABLES:  None  ** 

**  RETURNS: None  ** 

**  GLOBAL  VARIABLES  USED;  exact.  tG.rr  ** 

**  GLOBAL  VARIABLES  CHANGED:  exact,  tC],rr  ** 

**  FILES  READ:  The  file  containing  failure  data  ** 

**  FILES  WRITTEN : "converted.dat"  a  file  with  failure  ** 

•*  data  stored  in  the  form  of  failure  time  ** 

**  HARDWARE  INPUT:  Keyboard  '  ** 

**  HARDWARE  OUTPUT:  Screen  ** 

•*  MODULES  CALLED;  None  *• 

♦*  CALLING  MODULES;  The  main  program  ** 

**  AUTHOR;  Salah  A.  Elewa  *• 

**  HISTORY:  ** 

**  1.0  Salah  A.  Elewa  01/25/1992  *♦ 

**  original  version  ** 

*****•*•*•*••**•**•* ********************************4>**/ 

void  Get.Inf ormation(void) 

{ 

int  ch; 

char  FileName [MAX.STRING] ; 

FILE  *fp300; 

if  ((fp300  =  fopenC'convertd.dat",  "y+"))  ==  NULL) 
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puts("\t  can  not  open  converted.datXn") : 
exit(l)  ; 

} 

puts("\n\n\tEnter  Type  ol  Calculations  Exact  (e|E)  OR  Asymptotic  (alA)?\n\n" 
for  (: :) 

ch  =  getcheO; 

if  (ch  ==  'a'  II  ch  ==  'A') 

puts("syinptotic  calculations  requested\n\n") ; 
exact  =  FALSE; 

> 

else  if  (ch  ==  ’e’  II  ch  ==  ’E’) 

{ 

putsC'xact  calculations  requested\n\n’') ; 
exact  =  TRUE; 

} 

else  , 

i 

printf  ("\n\t\t\t  Sorry!  ‘/.c  is  Unknown  Choice",  ch) ; 
puts("\n\t\t  The  Letters  a,A,e,E  eire  Acceptable  Choices"); 
puts("\n\t\t  Try  Again  OR  Press  Ctrl+Break  to  Quit\n\n\n") ; 

> 

if  (ch  ==  'a’  II  ch  ==  'A'  ||  ch  ==  'e'  II  ch  ==  'E’) 
break ; 

> 

puts("\t\t  OK  !  Now  Enter  The  Name  of  Data  File  ?\n\n"); 
do 
{ 

for  (ch  =  getcharO;  isspace(ch);  ch  =  getcharO) 

;  /♦  Null  Statement  */ 

ungetc(ch,  stdin)  ; 
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gets(FileNaine)  ; 
puts("\n")  ; 

if  ((fplOO  =  f openCFileNajne ,  "r"))  ==  NULL) 

{ 

printf  ("\n\t\t  Can  NOT  Find  The  File  ’/,s\n"  ,  FileNcune); 

puts("\n\t\tEnter  the  CORRECT  File  Name  DR  Ctrl-C  to  ExitXn"); 

> 

} 

while  ((fplOO  =  fopen(FileNaffle ,  "r"))  ==  NULL); 
puts("\t\t  Enter  the  Type  of  the  Data  \n"); 

puts("\tFailures  Times  (fiF)  OR  Time  Between  Failures  (t |T)?\n\n‘‘) 
for  ( ; ; ) 

{  /»  infinite  loop  */ 

ch  =  getcheO  ; 
if  (ch  ==  'f ’  II  ch  ==  ’F’) 
putsC'ailure  times  \n\n"): 
else  if  (ch  ==  ’t’  II  ch  ==  'T’) 

{ 

puts("ime  between  failures  \n\n") ; 

rr  =  1; 

t[0]  =  0,0; 

while  (! feof (fplOO) ) 

{ 

fscanf (fplOO,  "'/.If  ",  *tCrr]); 
t[rr]  =  t[rr]  +  t[rr  -  l] ; 
fprintf  (fp300,  "V.lfXn",  t[rr]); 
rr++ ; 

} 

fplOO  =  fp300; 

} 

else 

{ 
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print!  ("\n\t\t\t  Sorry'  */.c  is  Unknown  Choice",  ch); 
puts(''\n\t\t  The  Letters  f.F.b.B  are  Acceptable  Choices"); 
puts("\n\t\t  Try  Again  OR  Press  Ctrl+Brezik  to  Quit\n\n\n") 

} 

il  (ch  ==  *1’  II  ch  ==  'F'  M  ch  ==  ’t>  II  ch  ==  'T') 
break ; 

> 

rewind(fplOO) ; 

!close(!p300) ; 
return ; 
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*♦  DATE:  01/25/1992  ** 

**  VERSION:  1.0  ** 

•  •  MODULE  NAME:  Estimate.nO  •» 

**  MODULE  NUMBER:  1.1.2  ** 

DESCRIPTION:  This  module  is  used  to  estimate  the  ** 
**  value  of  the  sample  size  n  amd  then  insert  it** 

**  on  the  top  of  the  failure  times  file  so  that  ** 

**  it  can  be  read  later  by  the  environment .The  ** 

•*  maximum  likelihood  estimation  method  is  used  *♦ 

**  for  estimating  n  as  described  in  Appendix  I.  ** 

**  PASSED  VARIABLES:  the  Pointer  to  the  file  where  ** 
*♦  failure  times  are  stored  ** 

*•  RETURNS:  None  ** 

**  GLOBAL  VARIABLES  USED:  tG.n.rr  *• 

**  GLOBAL  VARIABLES  CHANGED:  n  *• 

*•  FILES  READ:  The  file  containing  the  failure  times  ** 
**  or  the  times  between  failures  *• 

•*  FILES  WRITTEN:  “input . dat"  file,  which  has  the  est'-** 
**  imated  n  on  top  and  then  failure  times  »* 

**  HARDWARE  INPUT:  None  ** 

**  HARDWARE  OUTPUT:  None  ** 

**  MODULES  CALLED:  Module  D  described  in  Appendix  I  ** 
**  CALLING  MODULES:  The  main  program  ** 

**  AUTHOR:  Salah  A.  Elewa  ** 

**  HISTORY:  ** 

**  1.0  Salah  A.  Elewa  01/25/1992  ** 

**  original  version  ** 

♦**♦»*♦**♦*♦♦**♦*•*»»*♦•**•*•***•****•*♦♦••«***♦*♦***•♦/ 
void  Estimate_n(void) 

int  i  ; 

double  T,  max_t,  SS,  theta  =  1.0e37; 

FILE  *fp200; 
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T  =  roax_t  =  SS  =  0.0; 

if  ((fp200  =  f open ("input .dat" ,  "u+"))  ==  NULL) 

{ 

puts ("can  not  open  input .dat \n") ; 
exit(l) ; 

> 

rr  =  1; 

while  ( ! f eof (fplOO) ) 

{ 

fscanf  (fplOO,  "'/.If  ttCrr]); 
if  (t[rr)  <  theta) 
theta  =  t[rr]; 
if  (t[rr]  >  max_t) 
max,t  =  t[rr]; 

T  =  T  +  t  [rr]  ; 
rr+  +  ; 

} 

/ 

rr  =  rr  -  1; 

printf  (’'\t\tTotal  Number  of  Failures  r=  */.d\n"  ,  rr) ; 
SS  =(T-(double)  rr*theta)/(double)  rr/(max_t-theta) ; 
rewind(f plOO) ; 
for  (i  =  rr ; :  i++) 

if  (D(i.  rr)  <=  SS  it  SS  <  D(i  +  1.0,  rr)) 

{ 

n  =  i : 
break ; 

} 

> 

f printf  (fp200 ,  "*/,d  \n",  n); 
reuind(fplOO)  ; 
while  (  !f eof (fplOO) ) 

{ 
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Jscanf  (fplOO,  "’/.If  .  At[rr]); 

fprintf  (fp200,  "•/.If  \n"  ,  t  [rr]  ) ; 

> 

f close(fp200) ; 
return ; 


C-11 


*♦  DATE:  01/25/1992  ♦♦ 

*♦  VERSION;  1.0  ♦♦ 

*♦  MODULE  NAME:  Check_Exp()  ♦♦ 

♦♦  MODULE  NUMBER:  1.1.3  ♦♦ 

**  DESCRIPTION:  This  module  is  used  to  check  whether  ♦* 

♦♦  the  failure  times  are  exponential.  It  uses  ** 

*♦  G  test  based  on  the  Gini  statistic  for  check-** 

**  ing  exponentiality  of  type  II  censored  data.** 

**  PASSED  VARIABLES:  "’ointer  to  "Input.dat"  file  *♦ 

*♦  RETURNS:  None  ** 

**  GLOBAL  VARIABLES  USED:  t[],n,rr  ** 

**  GLOBAL  VARIABLES  CHANGED:  None  ** 

**  FILES  READ;  "input.dat"  file  ...  ** 

*♦  FILES  WRITTEN;  None  ** 

**  HARDWARE  INPUT;  None  ** 

**  HARDWARE  OUTPUT:  Screen  ** 

*♦  MODULES  CALLED:  None  ** 

**  CALLING  MODULES:  The  main  program  ** 

**  AUTHOR:  Salah  A.  Elewa  ** 

**  HISTORY:  ** 

**  1.0  Salah  A.  Elewa  01/25/1992  ** 

**  original  version  ** 

♦♦***♦**♦♦*♦*♦*♦♦♦♦*♦♦*♦**♦♦♦**♦*♦*♦*♦*♦♦**♦♦♦»♦*******/ 
void  Check_Exp(void) 

double  time_bet[MAX_FAILURES] ,  Wi [MAX_FAILURES] ; 

double  Witot,  nura,  den; 

double  Grn,  Var; 

int  i ; 


Witot  =  num  =  t[0]  =  0.0; 
for  (i  =  1;  i  <  rr  +  1;  i++) 
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{ 


tiine_bet[i3  =  t[i]  -  t[i  -  1]  ; 

Wi[i]  =  (n  -  i  +  1)  •  time.bet [i] ; 

Witot  =  Vitot  +  Ui[i]; 

> 

den  =  (rr  -  1)  •  Vitot; 
for  (i  =  1;  i  <  rr;  i++) 
num  =  num  +  i  »  Wi[i  +  l]; 

Grn  =  num  /  den; 

Var  =  pou(12  *  (n  -  1),  .5)  ♦  (Grn  -  0.i>); 

if  (Var  >  -2.33  tfc  Var  <  2.33) 

/♦  0.01  Significance  Level  is  Used  for  Calculations  */ 
puts("\n\t  Supplied  Data  Provided  Evidence  TovcO'ds  ExponentialityXn") ; 
else 
< 

puts("\t\t\tSupplied  Data  Provided  Evidence  Against  Exponentiality\n") : 
puts ("\t\t\t\t  Extra  Data  may  b'?  Neea^dXn"); 

/ 

puts ("\t\t\t\t  Prograun  will  Terminate  \n”); 
exit(l)  ; 

} 

reoindCfplOO)  ; 
f close(fplOO) ; 
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/•***»♦*»•*••*••**•♦**•*••*•♦**•*»*»•♦•*•♦*»»**•*♦•*••»* 

*•  DATE;  01/25/1992  »♦ 

**  VERSION:  1.0  »» 

**  MODULE  NAME:  D()  ** 

♦♦  MODULE  NUMBER:  1.1.4  ** 

*♦  DESCRIPTION:  This  module  is  used  for  calculating  *♦ 

.  **  the  value  of  the  Parameter  D  described  in 

*•  Appendix  I 

•*  PASSED  VARIABLES:  number  of  failures  r  emd  scunple  ** 
*♦  size  n.  *♦ 

*♦  RETURNS:  D  value  *♦ 

GLOBAL  VARIABLES  USED:  None  ** 

*♦  GLOBAL  VARIABLES  CHANGED:  None  ** 

♦♦  FILES  READ:  None  ♦♦ 

**  FILES  WRITTEN:  Hone  ** 

•*  HARDWARE  INPUT:  None 

*•  HARDWARE  OUTPUT;  None  •• 

**  MODULES  CALLED:  None  *♦ 

**  CALLING  MODULES:  Estimate.n  '  ** 

•*  AUTHOR;  Salah  A.  Eleua  •* 

*♦  HISTORY:  •* 

•*  1.0  Salah  A.  Elewa  01/25/1992  •* 

♦♦  original  version  •* 

♦*♦*•***♦♦♦***♦***♦♦*♦*♦♦**♦*♦*♦♦♦*****♦♦**♦**♦**♦♦♦♦**/ 
double  D(int  n,  int  r) 

{ 

double  nn,  rr ,  xx; 


nn  =  (double)  n; 
rr  =  (double)  r; 

XX  =  pou(rr*( 1 . 0-(pov( ( 1 . 0-(rr/nn) ) , (1 . O/rr) ) ) ) ,-l .0) ; 
return  (xx  +  1.0  -  (nn  /  rr)); 

} 
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/  **************  ^ritm^m*****  ****************  ***»**»*» 

**  DATE:  01/25/1992  •* 

*»  VERSION:  1.0  *• 

**  MODULE  NAME:  Print_Table_Header()  ** 

*•  MODULE  NUMBER:  1.1.5  •* 

♦♦  DESCRIPTION:  This  module  is  used  lor  printing  the  *♦ 
table  header  on  the  screen  and  in  the  "report** 
**  .dat"  file.  ** 

**  PASSED  VARIABLES:  None  ** 

**  RETURNS:  None  ** 

**  GLOBAL  VARIABLES  USED:  exact  ** 

**  GLOBAL  VARIABLES  CHANGED:  None  ** 

**  FILES  READ:  None  ** 

**  FILES  WRITTEN:  "report.dat"  file  ** 

•*  HARDWARE  INPUT:  None  ** 

**  HARDWARE  OUTPUT:  None  ** 

**  MODULES  CALLED:  None  ** 

**  CALLING  MODULES:  The  main  program  ** 

**  AUTHOR:  Salah  A.  Elewa  ** 

**  HISTORY:  ** 

*♦  1.0  Salah  A.  Eleva  01/25/1992  ** 

**  original  version  ** 

•♦**♦**♦»*♦••**»♦*•*****•**♦»•»*♦*♦•♦•♦•****•****•*«*•»/ 
void  Print_Table_H€ader (void) 

{ 

int  j; 

if  ((fp5  =  fopen("report . dat" ,  "u"))  ==  NULL) 

{ 

printfC’caLn  not  open  report.dat  fileXn"); 
exit(l) ; 

} 

print! ("\t\t\t  Likelihood  Ratio  Test  Program  \n"); 

fprintf(fp5,  "\t\t\t  Likelihood  Ratio  Test  Program  \n"); 
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if  (exact) 

{ 

print! (''\t\t  Exact  Method  for  Checking  Equality  of  Data  \n"); 
printf("\t\t  and  Proper  Model  Selection  \n"); 

f print! (fp5 , "\t\t  Exact  Method  for  Checking  Equality  of  Data  \n"); 
fprintf (fp5."\t\t  and  Proper  Model  Selection\n") ; 

> 

else 

{ 

printf("\t\t  Asymptotic  Method  for  Checking  Equality  of  Data\n"): 
printf("\t\t  and  Proper  Model  Selection  \n"); 

f print! (fp5 , "\t\t  Asymptotic  Method  for  Checking  Equality  of  DataXn"): 
fprintf (fp5 , "\t\t  and  Proper  Model  SelectionXn") ; 

> 

printfC'XtXt  The  Symbols  in  the  table  cire  Y(es)  or  N(o)Xn"); 
fprintf (fp5 , "XtXt  The  Symbols  in  the  table  are  Y(es)  or  N(o)Xn"); 
printfC'XtXt  The  Value  Under  Yes  or  No  is  (L-C)Xn’'); 
fprintf (fp5,"XtXt  The  Value  Under  Yes  or  No  is  CL-C)\n''); 

printfC'XtXt  For  Equality  L  must  be  greater  than  C  Xn"); 
fprintf (fp5,  "XtXt  For  Equality  L  must  be  greater  than  C  Xn"); 

print!  ("  | - [-")  ; 

fprintf (fp5,  "( - [-"); 

for  (j  =  1;  j  <  8;  j++) 

{ 

print!  (" - ")  ; 

fprintf (fp5,  " - "); 

> 

printfC - |Xn"); 

fprintf (fp5,  " - |Xn"); 

printfC" I  I  Significance  Level  c<  "); 

printfC  I"); 
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Iprintf (f p5 , " 1 
fprintf (ip5 . " 


Signif icamce  Level  CX  "): 


!•'); 

printf("\n|  1“"); 

f  print!  (fp5 ,  "Xn  I  1“''): 

for  (j  =  1:  j  <  8;  j++) 

{ 

printf  (" - 1*") ; 

fprintf(fp5,  " - 

> 

printf  (" - l\n"); 

fprintf(fp5,  " - |\n"): 

printfCM  F.  Setl. 00025  1  .0005  I  .001  I  .0025  I  .005 
printf  ("I  .01  I  .025  I  .05  I’’); 

fprintf (fp5,"l  F.  Setl. 00025  |  .0005  1  .001  1  .0025  I 

fprintf (fp5,"|  .01  I  .025  I  .05  I"); 

return ; 


■'); 


.005  ■•); 
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/*•»**•**««••**»•*«*****••****•*•****»*»••**»>»•*•»**»•* 

*•  DATE:  01/31/1992  •* 

**  VERSION:  1.0  ' 

*•  TITLE:  Computation  Routines  File  *♦ 

•*  FILENAME:  compute. c  •• 

♦*  COORDINATOR:  Salaii  Amin  Elewa 

*•  PROJECT: Development  of  an  Environment  for  Software  ** 
•*  Reliability  Model  Selection.  ** 

**  OPERATING  SYSTEM: MS  DOS  version  2.0  or  higher  •• 

**  LANGUAGE:  Turbo  C  (2.1)  *♦ 

**  FILE  PROCESSING:  Compile  and  link  with  files  prep.c** 

**  coefs.c,  prob.c,  and  pms.c  *♦ 

**  CONTENTS:  •* 

•*  1.2.1  -  Compare_Sets()  *• 

♦*  1.2.2  -  Check_Data_File( )  »* 

»*  1.2.3  -  Compute_LRT()  •» 

*♦  1.2.4  -  Compute_Percentile()  *• 

**  1.2.5  -  Print.ResultsO  »• 

•*  FUNCTION:  This  file  contains  the  modules  for  making** 
*♦  the  comparison  between  two  sets  of  data  and  ** 

*•  printing  the  results  in  the  file  "report .dat" .  ** 
•*•***********•****«*•**•*****•**•******•*»***•***•*•**/ 
<(include  <stdlib.h> 

^include  <stdio.h> 

^include  <ctype.h> 

^include  <math.h> 

^include  "defs.h" 


void  Compare_Sets(int) ; 

void  Print_Results (double ,  int); 

void  Compute_Percentile (double,  double,  double  *,  double  ♦); 

double  Compute_LRT(void) ; 

int  Check_Data_File(char  *); 


C-IS 


extern  FILE  *fp5; 

extern  double  lta[]  ; 

static  FILE  ♦fpl; 

static  boolean  DIFFERENT  =  TRUE; 

static  double  LRT.  XI [MAX.SAKPLES] .  Yi [MAX.SAMPLES] 
static  int  R,  Saniples_NO,SaBiple_ri[HAX_SAMPLES]  , 

Sample.Size [MAX_SAMPLES3 ; 
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/*•**•**•*»»***»•♦♦•*••*♦»*♦•••*»♦*»***•*♦•*••»*♦*♦»♦••• 

**  DATE:  01/31/1992  ** 

•*  VERSION:  1.0  •• 

**  MODULE  NAME:  Compare_Sets()  •* 

MODULE  NUMBER:  1.2.1  ** 

*♦  DESCRIPTION;  This  module  is  used  to  compare  the  two** 

.  **  sets  of  data  specified  in  the  corresponding  ** 

♦*  .fil  file.  It  first  invokes  Check_Data_File  *♦ 

•*  routine  to  make  sure  that  all  required  data  *♦ 

*•  for  comparison  exist  in  failure  times  files,  ♦♦ 

**  then  it  compares  input  file  with  other  sets  *♦ 

**  through  the  loop  J  using  the  value  of  LRT  *• 

*♦  and  the  percentile  point  C  from  the  routines  •* 

•*  Compute_LRT  amd  Compute.Percentile.  ** 

•*  PASSED  VARIABLES:  number  of  set  to  compao-e  with  (J)** 
**  RETURNS:  None  ** 

•*  GLOBAL  VARIABLES  USED:  Total  number  of  failures  (R)*» 
••  ,Samples_NO,  DIFFERENT, LRT  •• 

•*  GLOBAL  VARIABLES  CHANGED:  LRT  '  ** 

**  FILES  READ;  The  .fil  file  containing  two  sets  of  *• 

•*  data  to  be  compared  and  the  files  containing  »• 

*♦  failure  times  •• 

**  FILES  WRITTEN:  "report.dat"  file 

**  HARDWARE  INPUT:  None  *♦ 

*♦  HARDWARE  OUTPUT:  Screen  ** 

•*  MODULES  CALLED:  Check_Data_File()  *• 

Compute_LRT( )  •* 

Print_Results()  •* 

CALLING  MODULES:  The  main  prograun  ** 

**  AUTHOR;  Salah  Amin  Elewa  ** 

**  HISTORY:  ** 

*•  1.0  Salaih  Amin  Elewa  01/31/1992  ♦♦ 

•*  original  version  ** 

*•*••*•••***•*•»*••*•**•**••***•*•••••**•**•**••****•**/ 
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void  Coinpare_Sets( J) 

{ 

double  L; 
int  p  =  0; 

char  ln[MAX_STRING] ,  s [MAX.STRING] ; 

char  •fillile[]  =  <•'  "  .  "set.l .  f  il" ,  "set_2.1il", 
"set_4.fil","set_5.fil"."set_6.fil"."set.l4c.fil". 
"set_17.fil","set_27.f  il'',*'set_ssla.f  il","set_6slc.f  il", 
"set_SS3.1il"  .  "set_SS4.1il".  ••Lit_2 . f il" ,  "Lit_3 .f il">; 

R  =  Sajiiples_N0  =  0; 

if  (J  >  1) 

fclose(fpl)  ;  . 

if  ((fpl  =  fopen(f ilfileCJ] ,  “r"))  ==  NULL) 

{ 

printf("\n  can  not  open  ’/.s  file\n",  filfile[J]); 
exit(l) : 

> 

fgetsCs,  30,  fpl):  /•  read  1st  set  name  from  the  .fil  file  fpl*/ 
while  (!feof(fpl)) 

if  (sscanf(s,  '"/.s",  fn))  /♦  assign  s  to  file  fn  if  exist  ♦/ 
if  (Check_Data_File (f n) ) 

P++;  /*  Check  all  data  are  found  */ 

fgets(s,  30,  fpl);  /*  read  2nd  set  name  from  the  .fil  file  */ 

> 

if  (p  >  1) 

{ 

LRT  =  Compute_LRT( ) ; 

L  =  pow(LRT,  (l.O  /  (double)  R)); 

Print_R€sults(L,  J); 

} 

else 

{ 
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print!  (‘'\n\nError  LRT  can  not  be  computed  for  less  thain  2  samplesXn")  ; 
prirtf("\n  -  OR  -  May  be  one  of  the  failure  times  is  0.0  \n"); 
fprintf  (fp5 ,  "\nError  LRT  can  not  be  computed  for  less  than  2  seur.plesVn" ) 
fprintfCfpS,  "\n  -  OR  -  May  be  one  of  the  failure  times  is  0.0  \n"): 

} 

if  (J  ==  (DATA.FILES  -  1)) 

{ 

If  (!DIFFERENT) 

< 

printf  ("\n  ' - * - ")  ; 

printfC - '  \n"); 

f printf  (fpS  ,  "\n  * - 1 - "); 

fprintf (fpS , - 1  \n"); 

} 

else 

printf  ("Nn  ' - ■ - 1 - ^ - ■ - 1 - 1 —  ■') ; 

printf (•'  - ' - • - '  \n"); 

fprintf  (fp5,  "\n  ' - ■ - 1 - ■ - ■ - 1 - •'); 

fprintfCfpS,"  - 1 - ■ - ■ - 1  \n"); 

> 

fcloseCfpS) ; 
fclose(fpl) ; 

} 

return ; 
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••  DATE:  01/31/1992  •• 

VERSION:  2.0 

MODULE  NAME:  Check_Data_File()  *♦ 

**  MODULE  NUMBER:  1.2.2  *♦ 


**  DESCRIPTION:  This  module  is  used  to  read  the  files  ** 
**  containing  the  failure  data  and  return  TRUE  •* 


*•  if  all  information  needed  exist.  •* 

**  PASSED  VARIABLES:  Name  of  file  to  be  checked 
**  RETURNS:  TRUE  or  FALSE  (1  or  0)  ** 

**  GLOBAL  VARIABLES  USED:  Sample_Size [] ,  Sample_ri[],  *♦ 
**  Samples.NO,  Xl[3.  Ya[l  •* 


•*  GLOBAL  VARIABLES  CHANGED:  Sample_Size [] . Sample.r i [] , ♦ 


**  f  mples.NO,  XI  □  ,  YiG  ** 

•  *  F'L'^^  iiEAD:  fn  file  passed  as  an  argument  *♦ 
•*  FILES  WRITTEN:  None  ** 

HARDWARE  INPUT:  None  »* 
•*  HARDWARE  OUTPUT:  None  ** 
**  MODULES  CALLED:  None  '  •• 
•*  CALLING  MODULES:  Compare.SetsO  ** 
**  AUTHOR:  Salah  Amin  Elewa  •* 
♦*  HISTORY:  •* 
•*  1.0  Capt .  K.  N.  Cole  5/8  /1985  ** 
*♦  original  version  »* 
**  1.1  Capt.  K.  N.  Cole  10/25  /1986  *• 
♦*  modified  for  SAE  system  •* 

•  •  2.0  Saleih  Amin  Elewa  01/31/1992  ** 
•*  -  header  modified  ** 
•*  -  names  for  module  and  some  variables  ** 
**  changed  *♦ 


**  -  program  modified  to  work  with  2-p2Lra-*'» 
•*  meter  exponential  distribution  and  to** 
**  read  sample  size  from  file  "input.dat"* 

•*»**•*»»*****♦»♦••*♦♦**•***•*••*♦•**••*»♦*•***♦•♦••••♦/ 
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int  Check_Data_File(char  *fn) 


FILE 

*fp; 

booleam 

error; 

char 

*c; 

int 

ni,  ri; 

double 

t ,  Ti ,  maximum_t ,  tainimum.t 

t  =  Ti  = 

maxiiDuni_t  =  minimuin_t  =  0.0; 

If  (Samples.NO  >=  MAX.SAMPLES) 
error  =  TRUE; 


else 

{ 

error  =  FALSE; 
niaximiun_t  =  0.0; 
c  =  fn; 

mininiuiii_t  =  1.0e37; 
vhile  (isspace(*c)) 

C++; 

if  ((fp  =  fopenCc,  "r"))  '=  NULL) 

{ 

fscanfCfp,  "  Vid  ”,  ini); 
ri  =  0; 

Ti  =  0.0; 

while  (!feof(fp)) 

■C 

t  =  0.0; 

fscanf(fp,  "'/tlf  ",  it); 
if  (t  !=  0.0) 

{ 

if  (t  <  niinimuin_t) 
minimuin_t  =  t ; 
if  (t  >  maximuin_t) 
maximuni_t  =  t; 
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Ti  =  Ti  +  t; 
ri++; 

> 

else 

while  (!feof(fp)  tt  (fgetc(fp)  !=  '\n')); 

} 

f close(fp) ; 
il  (ni  <  ri) 
error  =  TRUE; 

if  ((Ti  ==  0)  II  (ri  ==  0)) 
error  =  TRUE; 

> 

else 

<  .  - 

print! ("Check_Data_File;  can't  open  data  file  */.s\n",  c) ; 
error  =  TRUE; 

} 

if  (!  error) 

< 

XI  [Samples.NO]  =  minimuni_t; 

Yi  [Sainples_NO]  =  (Ti-ri*Xl  [SaJDples_HO]  )  +  (ni-ri)*  (maxiniuiti_t-Xl  [Samples.NO]  )  ; 
Sainple_Size  [Saatiples_NO]  =  ni; 

Saunple_ri  [Saniples_NO]  =  ri; 

Sajnples_NO++ ; 

> 

> 

return  (! error); 


C-25 


*♦  DATE:  31/01/1992  ** 

**  VERSION:  1.0  •» 

*»  MODULE  NAME:  Conipute_LRT()  ** 

♦♦  MODULE  NUMBER:  1.2.3  *♦ 

*♦  DESCRIPTION:  This  module  is  used  to  compute  the  test* 
**  criteria  from  the  global  vciriables  ** 

•  ♦  (Samples_NO,Saunple_Size,  and  Scimple_ri)  .  ** 

** 

PASSED  VARIABLES;  ** 

**  RETURNS:  The  value  of  LRT  •* 

*•  GLOBAL  VARIABLES  USED;  Sample.Size  □  ,  Sample_ri[],  *♦ 
**  Sajnples_NO, total  #  of  failures  R,  Xl[],  Yi[]** 

*• 

♦  *  and  LRT  ** 

*•  GLOBAL  VARIABLES  CHANGED:  R,  LRT  ** 

**  FILES  READ;  None  *• 

•*  FILES  WRITTEN:  None  •* 

**  HARDWARE  INPUT:  None  •* 

**  HARDWARE  OUTPUT: None  •• 

MODULES  CALLED;  None  ** 

**  CALLING  MODULES;  Compare_Sets ( )  ** 

*•  AUTHOR:  Salah  Amin  Eleua  »* 

*♦  HISTORY:  *» 

**  1.0  Salali  Amin  Elewa  01/31/1992  ** 

**  original  version  •* 

**•*•***«***•****•*•»***•*«*••* *4,***»*** **««•** *«*****•/ 

double  Compute_LRT(void) 

{ 

double  paxtl,  paLrt2,  Yitot,  V,  u; 

int  1 ; 

double  Zp  =  1.0e37; 

psLTtl  =  pcLrt2  =  LRT  =  0.0; 


C-2G 


V  =  u  =  Yitot  =  0.0; 
if  (Sajnples_N0  >=  2) 

{ 

for  (i  =  0;  i  <  Saniples_N0;  i++) 
if  (XI  [i]  <  2p) 

Zp  =  XI [i] ; 

for  (i  =  0;  i  <  Sainples_NO;  i++) 

•c 

R  =  R  +  Sajnple_ri[i]  ; 
u  =  u  +  SaiBple_Size [i3  *  {Xl[i]  -  Zp); 

Yitot  =  Yitot  +  Yi[i]; 

} 

V  =  Yitot  +  u;  .  . 

parti  =  (double)  R  •log( ( (double)  R  /  V)); 
part2  =  0.0; 

for  (i  =  0;  i  <  Samples.NO;  i++) 

part2=part2+(double)Safl!p2e_riEi3»log(yi [i}/(double)Sample_ri [i] ) 
LRT  =  exp(partl  +  part2) ; 

} 

return  (LRT) ; 
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♦♦  DATE:  01/31/1992  ** 
**  VERSION:  1.0  ** 
**  MODULE  NAME:  Print_Results ()  *♦ 
»*  MODULE  NUMBER:  1.2.4  ** 


*♦  DESCRIPTION:  This  module  is  used  to  print  the  resu-** 
**  Iting  table  on  both  the  screen  and  the  output  ** 


•  ♦  file  ''report.dat*'.  ** 
**  PASSED  VARIABLES:  L,  Failure  Data  Set  number  ** 
*♦  RETURNS:  None  ** 
**  GLOBAL  VARIABLES  USED:  DIFFERENT  •* 
»•  GLOBAL  VARIABLES  CHANGED:  DIFFERENT  •» 
•*  FILES  READ:  None  *♦ 
**  FILES  WRITTEN:  "report.dat”  pointed  to  by--fp6  •* 
**  HARDWARE  INPUT:  None  •* 
**  HARDWARE  OUTPUT:  Screen  *• 
•*  MODULES  CALLED:  Compute_Percentile  ♦» 
**  CALLING  MODULES:  Compare_Sets()  ** 
**  AUTHOR:  Salah  Amin  Elewa  ** 
•*  HISTORY:  •» 

•  ♦  1.0  Salaih  Amin  Elewa  01/31/1992  ** 
♦♦  original  version  *• 


j#4r#t««4(«#4r#:^*»4(*«**«;«*«*****#*4(4c*4(*****«***«4c»4(*  *♦«*****/ 

void  Print_Results(double  L,  int  J) 

{ 

int  i,  j,  k; 

double  alpha[MAX_ALPHA]=-C. 00025, .0005, .001, .0025, .005, .01, .025, .05>; 
double  C[MAX_ALPHA] ,  prb; 

char  *SET_NAHE[DATA_FILES]=-("  SET.l  SET_2  SET_4  SET_5 

"  SET_6  ","SET_14c","SET_17  ","SET_27  ” ,"SET_Sla" , "SET_Slc" , 

"SET_SS3" , "SET_SS4" , "SET_Lt2" , "SET_Lt3"> ; 

if  (L  >  .999) 
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DIFFERENT  =  FALSE; 

printl("\n  | - h“); 

fprintf  (fp5,''\n  I - i"") ; 

for  ( j  =  1 ;  j  <  8 ;  j++) 

print!  (" - ; 

pr intf  ( " - 1  \n"  )  ; 

for  (j  =  1;  j  <  8;  j++) 

fprintf (fp5,  " - 

fprintf Cfp5,  " - |\n"); 

print! ("I '/.si".  SET_NAME[J  -  iD); 
fprintf (fp5.  "I'/.sl",  SET_NAME[J  -  1]); 

print! ("  Two  Identical  Sets  or  Set  Compared  with  Itself  L  =  1.0  1") 

fprintf (fp5 , "  Two  Identical  Sets  or  Set  Compared  with  Itself  L  =  1.0 


if  (J  <  (DATA.FILES  -  2)) 

< 

print! ("\n  1 - h")  ; 

fprintf  (fp5,  "\n  I - 1~"); 

for  (j  =  1;  j  <  8;  j++) 

print! (" - p ")  ; 

print!  (" - 1  \n")  ; 


for  (j  =  1;  j  <  8;  j++) 

fprintf (fp5,  " - T"); 

fprintf(fp5,  ” - |\n"); 

} 

} 

else 

{ 
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If  (DIFFERENT) 

{ 

printf("\n|-*') ; 
fprintf(fp5,  "\n|-"): 

for  (j  =  1;  j  <  9;  j++) 

printfC” - f-’*); 

printf  (" - l\n**)  ; 

for  (j  =  1;  j  <  9;  j++) 

fprintf(fp5,  " - h"); 

fprintf(fpS,  " - !\n"): 

}  . . 

printf  ( "17.81".  SET_NAME[J  -  l]); 
fprintf(fp5.  "IV.sl",  SET_NAME[J  -  l3); 
for  (i  =  0;  i  <  MAX.ALPHA;  i++) 

Compute_Percentile(alpha[i] ,L,&C[i] ,tprb) ; 
if  (L  <  C[i]) 

printf  ("K/y.3.21f  I",  L  -  CCi]); 

fprintf(fp5,  "N/7.3.21f  I",  L  -  C[i]); 
for  (k  =  i;  k  <  7;  k++) 

printfC  1"): 

fprintfCfpS,  "  I"); 

} 

i  =  8;  /*  not  to  recalculate  if  it  is  rejected  */ 

> 

else 

printf  ("Y/y.4.31f  I",  L  -  C[i]); 
fprintfCfpS,  "Y/y.4 . 31f  I  "  ,  L  -  C[i]); 
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} 

} 

printf("\nl  I"); 

lprintl(fp5,  "\nl  I"); 

for  (i  =  0;  i  <  MAX. ALPHA;  i++) 

■C 

if  (L  <  C[i])  , 

{ 

printf ("L=y.4.31f I".  L); 

fprintf(fp5,  "L=*/.4 . 31f  I "  ,  L)  ; 
for  (k  =  i;  k  <  7;  k++) 

printf ("  I"); 

fprintf(fp5,  "  I"); 

> 

i  =  8;  /•  not  to  recalculate  if  it  is  rejected  */ 

} 

else 

{ 

printf  ("L=*/.4 . 31f  I  "  ,  L)  ; 
fprintf(fp5,  "L=’/.4 . 31f  I"  ,  L); 

> 

> 

printf ("\n I  I"); 

fprintf(fp5,  "\nl  I"); 

for  (i  =  0;  i  <  MAX.ALPHA;  i++) 

{ 

if  (L  <  C[i]) 

{ 

printf("C=V.4.31f  1",  C[i]); 
fprintf(fp5,  ••C=V.4.31f  I".  C[i]): 
for  (k  =  i;  k  <  7;  k++) 

{ 

printf ("  I"); 
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fprintfdpB,  "  I"); 

> 

i  =  8;  /♦  not  to  recalculate  if  it  is  rejected  •/ 

} 

else 

{ 

printf(''C=y.4.31f  I".  C[i]); 
fprintfCfpS,  "C=y.4 . 31f  I  .  C[i]); 

> 

> 

DIFFERENT  =  TRUE; 

> 

return ; 
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••  DATE:  01/31/1992 
••  VERSION;  2.0 

•*  MODULE  NAME;  Compute_Percentile() 
MODULE  NUMBER;  1.2.5 


•*  DESCRIPTION:  This  module  is  used  to  compute  the 

percentage  point  necessary  lor  evaluating  the  ** 
•*  LRT  criteria  at  the  values  given  by  the  global** 

•*  variables  Sample_ri,  total  failures,  and  the  ** 

**  significance  level  alpha  ** 

**  PASSED  VARIABLES:  alpha. LRT 

**  RETURNS; values  stored  in  the  locations  pointed  to  by* 


**  pet  -  percentage  point  for  alpha  value  given,  and** 
**  prb  -  probability  value.  •• 

•*  GLOBAL  VARIABLES  USED;  ka[] ,R,LRT,Samples_NO,  ** 

•«  Sample_ri  •* 

••  GLOBAL  VARIABLES  CHANGED:  kaC]  *• 

*•  FILES  READ:  None  ** 

•*  FILES  WRITTEN;  None  '  ** 

**  MODULES  CALLED:  ProbO ,Neston() .Ri.Coef 0 , Ar.Coef ()*• 
**  CALLING  MODULES:  Print_Results()  •• 

*•  AUTHOR;  Salah  Amin  Elesa  •* 

HISTORY; 1.0  Capt .  K.  N.  Cole  5/8  /1985  *• 

*♦  original  version  ** 

*♦  1.1  Capt.  K.  N.  Cole  10/25  /1986  ** 


*  * 

** 

*• 

** 

*♦ 

»* 

♦  ♦ 

** 


modified  for  SAE  system  •* 

2.0  Salah  Amin  Eleoa  01/31/1992  *♦ 

-  header  modified  •* 

-  names  for  module  and  some  variables  *• 

changed  ** 

-  program  modified  to  work  with  2-para-*» 
meter  exponential  distribution  and  to** 
read  sample  size  from  file  "input.dat"* 
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void 


Compute_Percentile(double  alpha, double  LRT, double  »pct, double  ‘prb) 


{ 


extern  double 

extern  double 

extern  double 

extern 

extern  void 

double 

int 


Ar[DATA_FILES  +  l] ; 

Prob (double .double .double , int .double, double) ; 

Newton (double, double .double .double , int .double .double) ; 
Ar.Coef (double,  double); 

Ri_Coel (double,  double,  double,  double); 

V,  a,  t,  p,  sum,  m,  delta; 
i ; 


m  =  delta  =  sum  =  a  =  0.0; 

p  =  (double)  Scunples_N0; 

for  (i  =  0;  i  <  Samples^NO;  i++) 

ka[i]  =  (double)  Sample_ri[i]  /  (double)  R; 

V  =  3.0  •  (p  -  1.0)  /  2.0; 
t  =  (p  +  1.0)  /  (6.0  •  p); 
for  (i  =  0,  sum  =  0.0;  i  <  Samples_N0;  i++) 
sum  =  sum  +  1.0  /  ka[i]; 

delta  =  (13.0  *  (sum  -  1.0))  /  ((p  -  1.0)  *  18.0); 
a  =  (1.0  -  v)  /2.0; 
m  =  ((double)  R  -  delta)  /  p; 

Ri_Coef(p,  delta,  a,  v) ;  /‘initialize  coefficients*/ 
•prb  =  Prob(a,  v,  p,  R,  LRT,  m); 

*pct  =  Newton(a,  v,  t,  p,  R,  alpha,  m) ; 
return ; 
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**  DATE;  01/16/1992  *• 

**  VERSION:  1.0  •* 

**  TITLE:  Probability  Computation  File  •» 

*•  FILENAME:  Prob.c  •* 

**  COORDINATOR:  Salah  Amin  Elewa  •* 

**  PROJECT: Development  of  an  Environment  for  Software  •* 

*♦  Reliability  Model  Selection.  •* 

•*  OPERATING  SYSTEM: MS  DOS  version  2.0  or  higher  ♦* 

*•  LANGUAGE:  Turbo  C  (2.1)  ♦* 

FILE  PROCESSING:  Compile  and  link  with  files  prep.c** 

*♦  coefs.c,  compute. c,  and  pms . c  •* 

**  CONTENTS:  ** 


♦  ♦  1.3.1  -  ProbO  • 

**  1.3.2  -  NewtonO  *♦ 
■**  1.3.3  -  InGammaO  •» 
«*  1.4.4  -  IxO  *• 
*♦  1 .4.5  -  Betacf ()  ** 

•  *  1.4.6  -  Inv.BetaO  ,  •* 
•*  FUNCTION : This  file  contains  the  modules  for  Comput-** 
*♦  ing  the  distribution  function  and  calcula-** 
•*  ting  the  percentage  point  using  Newton’s  ** 
*♦  approximation  method  ** 
****«*****••*******•**•****••*•*•***•***••••*»****•»*«*/ 


#include  <stdio.h> 
#include  <math.h> 
•include  "defs.h" 


boolean  exact=TRUE; 
extern  double  RiG,  ka[]  ; 

double  Prob (double .double .double , int .double. double) . lnGamma( double) ; 
double  Newton(double .double .double. double . int .double .double) ; 

static  double  Ix(double.  double,  double); 
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•*  DATE;  01/16/1992  •• 
•*  VERSION:  1.0  *♦ 
*»  MODULE  NAME;  Prob()  •• 
••  MODULE  NUMBER:  1.4.1  *» 
*♦  DESCRIPTION;  This  module  is  used  lor  computing  the  ** 
*•  distribution  function  of  x  •* 
**  PASSED  VARIABLES;  a.  v,  p.  R.  x.  m  *• 
♦*  RETURNS :Prob  (double)  •* 
**  GLOBAL  VARIABLES  USED:  Ri[] .  ka[] ,  exact.  R  *• 
*•  GLOBAL  VARIABLES  CHANGED;  None  *• 
*♦  FILES  READ:  None  •* 
**  FILES  WRITTEN: None  ** 
**  HARDWARE  INPUT:  None  '  ** 
*♦  HARDWARE  OUTPUT -.None  ** 
*♦  MODULES  CALLED:  InGaimnaO,  Ix()  •• 
»*  CALLING  MODULES:  Compute_Percentile() ,  NewtonO  •• 
*•  AUTHOR:  Salah  A.  Elewa  •• 
*♦  HISTORY:  •* 
**  1.0  Salah  A.  Elewa  01/16/1992  •* 
*•  original  version  •* 


*****»***^^,^,m**********r****»*»******  ********  »**•*•****/ 

double 

ProbCdouble  a, double  v, double  p.int  R, double  x, double  m) 

< 

int  i  ,  k ; 
double  Rdsh  ,ts\iin,t2  ,  K3; 
tsum=Rdsh=0.0; 
if  (exact) 

{ 

for  (k  =  0,  t2  =  0.0;  k  <  (int)  p;  k++) 
t2=t2+( ( ( (double )R*ka [k]-l .5)*log(ka[k] ) )-lnGajnma( (double)R*ka[k] -1 . 0) )  ; 
K3=exp(lnGajnma((double)R-l .0)+t2-v*log(p)+0.5*(p-l .0)*log(2.0»3. 14159)) ; 
for  (i  =  0,  t2  =  0.0;  i  <=  limit;  i++) 
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{ 

Rdsh=exp(lnGzLmina(  (double)ni+a)-lnGajmna(  (double)m+a+v+i) ) 
t2  =  t2  +  Ri[i]  *  Rdsh  *  Ix((double)  m  +  a,  v  +  i,  x); 

> 

tsuin  =  K3  »  t2; 

> 

else 

tsum=Ix(m+a,v,x)+Ri[2]*(lx(ni+a,v+2,x)-Ix(ni+a,v,x))/m/m: 
return  (tsum) ; 
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/**••****•*****••»»*•*••»**»•*»**>•*«*•*••••*•**•*•»**»» 

**  DATE:  01/16/1992  •• 

••  VERSION;  1.1  ** 

•  *  MODULE  NAME;  NewtonO  •* 

*•  MODULE  NUMBER;  1.4.2 

*♦  DESCRIPTION :This  module  is  used  for  computing  the  ** 

**  percentage  point  using  Newton’s  approx-** 

**  imation  method  ** 

**  PASSED  VARIABLES:  a,  v,  p,  t,  R,  alpha,  m  ** 

**  RETURNS ; Newton  (double)  ** 

**  GLOBAL  VARIABLES  USED;  DATA_FILES.  R  ** 

**  GLOBAL  VARIABLES  CHANGED;  None  ** 

**  FILES  READ:  None  ** 

**  FILES  WRITTEN: None  .  ** 

**  HARDWARE  INPUT:  None  ** 

**  HARDWARE  OUTPUT: None  ** 

**  MODULES  CALLED;  Prob(),  Inv_Beta()  ** 

**  CALLING  MODULES:  Compute_Percentile( ) ,  Process.Equal* 

**  and  Process.Unequal  in  table. c  <  ** 

**  AUTHOR:  Salah  A.  Elewa  ** 

**  HISTORY;  ** 

**  1.0  Capt .  K.  N.  Cole  01/05/1985  ** 

**  Initial  Version  ** 

**  1.1  Salah  A.  Elewa  01/16/1992  ** 

**  Header  modified.  Variable  names  changed  ** 

♦♦♦**»♦*•♦♦•**♦*******♦****••*•••*•♦*»•*♦****♦♦♦»******/ 
double 

Hewton(double  a, double  v, double  t, double  p,int  R, double  alpha, double  m) 

double  Inv_Beta(double ,  double,  double); 

double  zCNEWTON.LIMIT  +  2],  pa[NEWTON_LIMIT  +  2]; 

double  sp,  x; 

int  K,  done; 
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z[l]  =  Inv_Beta(alpha ,  (double)  R  -  t,  v); 

If  (p  <=  3.0) 

z[2]  =  z[l]  +  O.OS; 
else  if  (z[l]  >  0.05) 
z[2]  =  z[l]  -  0.05; 
else 

z[2]  =  z[l]  /  2.0; 

X  =  z[l]  ; 

sp  =  Prob(a,  v,  p,  R,  x.m); 
pa[l]  =  sp; 
done  =  FALSE; 

for  (k  =  2;  (k  <=  NEWTON _LIMIT)  kb  'done;  k++) 

if  (z[k]  >  1.0) 

zW  =  z[k  -  1]  +  ((1  -  z[k  -  1])  /  2.0); 

X  =  z[k]  ; 

sp  =  Prob(a,  v,  p,  R,  x,m); 
pa[k]  =  sp; 

if  (fabsCsp  -  alpha)  <  0.0000001) 
done  =  TRUE; 
else 

z[k+l]  =  2[k] -(z[k]-z[k-l] )*(sp-alpha)/(sp-pa [k-l] ) ; 
if  (z[k  +  l]  <  0.0) 

z[k  +  l]  =  z[k]  /  2.0; 

If  ((sp  >1.0)  II  (sp  <  0.0)) 

{ 

printf  ("\nHewton.c:Incorrect  Prob  Value  '/.f  ’/.f  \n",x,sp) 
done  =  TRUE; 

> 

} 

return  (z[k  -  1] )  ; 

} 
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»*  DATE:  01/16/1992  ** 

*•  VERSION:  1.1  ** 

**  MODULE  NAME:  InGamnaO 

♦*  MODULE  NUMBER:  1.4.3  *• 

**  DESCRIPTION : This  module  is  used  for  computing  the 
♦»  the  natural  log  of  the  Gcunma  function  ♦♦ 

♦*  PASSED  VARIABLES:  dx  ** 

**  RETURNS :lnGamma  (double)  ** 

•»  GLOBAL  VARIABLES  USED:  None  ** 

**  GLOBAL  VARIABLES  CHANGED:  None  *♦ 

••  FILES  READ:  None  •* 

♦*  FILES  WRITTEN: None  _  ** 

*•  HARDWARE  INPUT:  None  •* 

**  HARDWARE  OUTPUT; None  •• 

*•  MODULES  CALLED:  None  ** 

»*  CALLING  MODULES;  ProbO,  Ix()  •* 

*•  AUTHOR:  Salah  A.  Elewa  •* 

**  HISTORY:  ** 

*•  1.0  Capt.  K.  N.  Cole  01/05/19S5 

**  Translated  from  Pascal  code  *♦ 

**  (Original  by  Capt.  Mark  Amell)  ** 

**  1.1  Salah  A.  Elewa  01/16/1992  ** 

**  Header  modified,  module  name  changed  *♦ 

***♦****»»»*•**♦♦♦*•*♦•*♦•»**••♦♦****•**•»**♦*•**♦»***♦/ 


double  lnGaLmma(double  dx) 

double  rdo,  dy,  dterm,  de,  da,  db,  domeg,  dlggm; 

double  ds,  dz ,  du,  dv ,  du,  dt,  dr,  dq,  dp; 


rdo  =  0.0; 
dy  =  dx; 
dterm  =  1.0; 
de  =  1.0; 
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domeg  =  1 . 0e25 ; 
da  =  0.9999999999; 
db  =  1.0000000001; 
dlggm  =  domeg; 
if  (dx  >=  rdo) 

{ 

dlggm  =  rdo; 

if  ((dx  <=  da)  II  (dx  >=  db)) 

{ 

if  ((dx  <=  (da  +  de))  II  (dx  >=  (db  +  de))) 

{ 

while  ((dy  -  18.00)  <=  0.0) 

{ 

dterm  =  dterm  •  dy; 
dy  =  dy  +  de; 

> 

ds  =  de  /  (dy  •  dy) ; 

dz  =  (double)  0.0054102S6410256410; 

dw  =  (double)  -0.001917526917526918; 

dv  =  (double)  0.0008417608417518418; 

du  =  (double)  -0.0005952380952360952; 

dt  =  (double)  0.0007936507936507937; 

dr  =  (double)  -0.002777777777777778; 

dq  =  (double)  0.08333333333333333; 

dp  =  (double)  0.9189385332046727; 

dlggm  =  ( (dy-0 . 5)*log(dy) )+dp-dy-log(dterm) 

dlggm  =  dlggm+ ( ( ( ( ( (dz*ds+dw)*ds+dv)»ds+du) 

ds  +  dt)  *  ds  +  dr)  *  ds  +  dq)  /  dy; 

> 

> 

> 

return  (dlggm) ; 

} 
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/*******»*•**»♦*♦♦♦*♦**♦*♦♦•***♦••»»••••»♦••*»•••**•**•♦ 

*•  DATE:  01/16/1992  ♦* 

**  VERSION:  1.1  *♦ 

MODULE  NAME:  Ix()  *♦ 

*♦  .lODULE  NUMBER:  1.4.4  *♦ 

**  DESCRIPTION : This  module  is  used  for  calculating  the** 

**  Incomplete  Beta  function  using  the  con-** 

■  **  tinued  fraction  method.  ** 

**  PASSED  VARIABLES:  a,b,x  ** 

**  RETURNS :Ix(double)  ** 

**  GLOBAL  VARIABLES  USED:  None  ** 

**  GLOBAL  VARIABLES  CHANGED:  None  ** 

**  FILES  READ:  None  ** 

**  FILES  WRITTEN: None  ,  .  __  ** 

**  HARDWARE  INPUT:  None  ** 

**  HARDWARE  OUTPUT: None  ** 

**  MODULES  CALLED:  BetacfO,  lnGamma()  ** 

•*  CALLING  MODULES:  Prob(),  Inv_Beta()  ** 

**  AUTHOR:  Salah  A.  Elewa  ** 

**  HISTORY:  '  ** 

**  1.0  Taken  from  "Numerical  Recipes  in  C"  by  *» 

**  William  H.  Press  emd  Others,  Cambridge  ** 

**  University  Press ,pp. 179, 1990 .  ** 

**  1.1  Salah  A.  Elewa  01/16/1992  ** 

**  Header  Added,  nrerrorO  function  replaced** 

**  by  printfO  fiinction  ** 

***********************••*•******************•*********/ 
double  Ix(double  a, double  b, double  x) 

double  Betacf (double  a,  double  b,  double  x); 

double  bt; 

if  (x  <  0.0  II  X  >  1.0) 

printfC'Bad  x  in  routine  Ix()\n"); 
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if  (x  ==  0.0  I  I  X  ==  1.0) 
bt  =  0.0; 

else  /•  Factors  in  front  of  the  continued  fraction  •/ 

bt=exp(lnG2unnia(a+b)-lnGcumna(a)-lnGainina(b)+a*log(x)+b*log(l-x)  ) 
if (x<(a+l .0)/(a+b+2.0))/»  Use  continued  fractions  directly  ♦/ 
return  bt  ♦  Betacf(a,  b,  x)  /  a; 
else 

return  1.0  -  bt  *  Betacf(b,  a,  1.0  -  x)  /  b; 

/•Use  continued  fractions  after  m2LKing  synunetry  transformation*/ 
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/•*♦♦*♦♦*•*»♦*♦**•♦♦**•••♦♦***•*•»•**»»•♦•*♦*♦*•*•****»* 

**  DATE:  01/16/1992  *♦ 

♦*  VERSION:  1.1  ** 

**  MODULE  NAME:  BetacfO  *♦ 

*•  MODULE  NUMBER:  1.4.S  *• 

»♦  DESCRIPTION :This  module  is  used  for  evaluating  the 
.  •*  continued  fractions  for  the  Ix()  funct-** 

*♦  tion  above.  *» 

♦♦  PASSED  VARIABLES:  a.b.x  *♦ 

**  RETURNS :Betacf (double)  ♦* 

♦*  GLOBAL  VARIABLES  USED:  None  ** 

**  GLOBAL  VARIABLES  CHANGED:  None  ♦* 

FILES  READ:  None  ** 

*♦  FILES  WRITTEN: None  •* 

*•  HARDWARE  INPUT:  None  •* 

**  HARDWARE  OUTPUT: None  •* 

**  MODULES  CALLED:  None  *• 

•*  CALLING  MODULES:  Ix()  *• 

•*  AUTHOR:  Salah  A.  Elewa  ** 

**  HISTORY:  •• 

•  ♦  1.0  Taiken  from  "Numerical  Recipes  in  C"  by  »* 

*♦  William  H.  Press  and  Others,  Cambridge  *• 

♦♦  University  Press ,pp. 180, 1990 .  •• 

**  1.1  Salah  A.  Elewa  01/16/1992  *• 

•*  Header  Added,  nrerrorO  function  replaced** 

**  by  printfO  function  ** 

t»*^m*ti*^*:^:m*******m*»********************0****  ********/ 

double  Betacf (double  a,  double  b,  double  x) 

{ 

double  qap,  qaun,  qab,  era,  tern,  d; 
double  bz,  bm  =  1.0,  bp,  bpp; 
double  az  =  1.0,  am  =  1.0,  ap,  app,  aold; 
int  m; 
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qab  =  a  +  b; 

qap  =  a  +  1.0; 

qam  =  a  -  1.0; 

bz  =  1.0  -  qab  *  x  /  qap ; 

for  (m  =  1;  m  <=  ITHAX;  in++) 

< 

/*  continued  fraction  evaluation  by  the  recurrence  method  */ 
em  =  (double)  m; 
tem  =  em  +  em; 

d  =  em  ♦  (b  -  em)  •  x  /  ((qam  +  tem)  *  (a  +  tem)); 
ap  =  az  +  d  *  am; 

/*  One  step  (the  even  one)  of  the  recurrence  •/ 
bp  =  bz  +  d  ♦  bm; 

d  =  -(a  +  em)  *  (qab  +  em)  *  x  /  ((qap  +~'tem)  *  (a  +  tem)); 
app  =  ap  +  d  ♦  az ; 

/*  Next  step  of  the  recurrence  (the  odd  one)  */ 
bpp  =  bp  +  d  *  bz; 

aold  =  az;  /•  Save  the  old  answer  */ 

am  =  ap  /  bpp;  /*  Renormalize  to  prevent  overflows  */ 

bm  =  bp  /  bpp; 

az  =  app  /  bpp; 

bz  =  1.0; 

if  (fabs(az  -  aold)  <  (EPS  ♦  fabs(eiz))) 

return  az;  /*  Are  we  done  */ 

} 

printf("a  or  b  too  big  or  ITMAX  too  small  in  BETACAF  \n"): 
return  0.0; 
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/*•********»«**•*•»*»«**«**••*•***#******»»**»»**»*»•*•* 

••  DATE:  01/16/1992  ** 

**  VERSION:  1.1  *• 

*♦  MODULE  NAME:  Inv.Beta  •» 

•*  MODULE  NUMBER:  1.4.6  ♦* 

*♦  DESCRIPTION : This  module  is  used  for  computing  the  ** 
*♦  inverse  Beta  function  *♦ 

*»  PASSED  VARIABLES:  alpha,  p.  q  ** 

*♦  RETURNS : Inv_Beta(double)  •* 

**  GLOBAL  VARIABLES  USED:  None  *• 

GLOBAL  VARIABLES  CHANGED:  None  ** 

♦»  FILES  READ:  None  *» 

•*  FILES  WRITTEN: None  •  —  ** 

•*  HARDWARE  INPUT:  None  »* 

••  HARDWARE  OUTPUT: None 

**  MODULES  CALLED:  Ix()  •* 

•  •  CALLING  MODULES:  NewtonO  *• 

**  AUTHOR:  Salah  A.  Elewa  *• 

•*  HISTORY:  »* 

••  1.0  Capt.  K.  N.  Cole  01/05/1985  •* 

**  Translated  from  Pascal  code  *• 

•*  (Original  by  Capt.  Mark  Amell)  •• 

••  1.1  Salah  A.  Eleoa  01/16/1992  •* 

**  Header  modified,  module  name  changed  ** 

»«**4t*«*«************«* •**«•** •******«*•*•****••**•**•*/ 

double  Inv_Beta(double  alpha,  double  p,  double  q) 

•C 

int  jj,jend,j,i; 

double  dp ,dl ,dif ,dlx,dux ,dmp,decr ,dmpu ,dm  ,dn,du ,dfd , 
dabf ,df une , espl ,esp2 ,esp3 ,esp4 ; 
boolean  flag; 
double  darg[5] ,dfun[53 ; 


espl  =  1 .Oe-180; 
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esp2  =  1 . Oe-13 ; 
esp3  =  1 . Oe- 1 1 ; 
esp4  =  1 . Oe-10 ; 
dp  =  alpha; 
dm  =  p: 
flag  =  TRUE; 
dn  =  q; 
du  =  1.0; 

if  (((dp*  (du-dp))<0.0) I  I ((dm<0.0) i I (dn<0.0))) 

drop  =  0.0; 

else  if  ((dp  *  (du  -  dp))  ==  0.0) 
drop  =  alpha ; 
else  if  (dm  ==  1.0) 

drop  =  du  -  exp((du  /  dn)  •  log(du  -  dp)); 
else  if  (dn  ==  1.0) 

drop  =  exp((du  /  dm)  *  log(dp)); 
else 
{ 

flag  =  FALSE; 
dl  =  0.0; 
dif  =  1.0  /  3.0; 
dlx  =  -dp; 
dux  =  du  -  dp; 

jj  =  0; 

dmpu  =  0.0; 
jend  =  3; 

while  ((jj  <  25)  tt  (!flag)) 

{ 

if  (jj  ==  25) 
jend  =  3; 

jj  =  jj  + 
j  =  i; 

while  ((j  <=  jend)  Aft  (!flag)) 
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dmp  =  (du  +  dl)  /  2.0; 

i  =  1; 

if  ( ((du-dl)<espl) I  I { ((du-dl)<{esp2*dp) )tft(dl>esp2) ) ) 
flag  =  TRUE; 
else 

while  ((i  <  3)  tt  (!flag)) 

{ 

dargCi]  =  dl  +  (du  -  dl)  *  dif  ♦  i; 
dfunCi]  =  Ix(dffi,  dn,  darg[i])  -  dp; 
if  (dfunCi]  ==  0) 
daip  =  darg[i]; 
if  (dfun[i]  ==  0) 
flag  =  TRUE; 

else  if  ((dfun[i]  <  0.0)  kt  (i  ==  2)) 

dl  =  darg[2] ; 
dlx  =  dfun[2]; 

} 

else  if  (dfun[i]  >  0.0) 

du  =  darg[i]  ; 
dux  =  dfunCi]; 
if  (i  ==  2) 

{ 

dl  =  dargCl] ; 
dlx  =  dfunCl]; 

} 

else 
i  =  2; 

> 

+  +  i; 

> 

+  +  j; 
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if  (!flag) 

< 

jend  =  2; 

dmp  =  (du  +  dl)  /  2.0; 
dfd  =  dux  -  dlx; 

if  ((dfd  <  esp3)  tt  (dfd  <  (esp4  *  dp))) 
flag  =  TRUE; 

} 

if  ('flag) 

{ 

deer  =  dux  •  (du  -  dl)  /  dfd; 
dmp  =  du  -  deer; 

if ( ( (dmp-dl) <espl) I  I ( ((dnip-dl)<esp2)t&(dl>esp2) ) ) 
flag  =  TRUE; 
if  (!flag) 

{ 

dfun[3]  =  Ix(dm.  dn,  dmp)  -  dp; 
dabf  =  fabs(dfun[3]) ; 

dfune  =  dfun[3] ;  ' 

if ( ( (dabf <esp3) tt (dabf <(esp4*dp) ) ) I  I ( (dmp<espl ) 1  I 
(((du-dmpu)<esp2)t4(du>0. 999999999999)) I  I 
(dfun[3]  ==  0.0))) 
flag  =  TRUE; 

} 

if  (Iflag) 

{ 

if  (dfun[3]  <  0.0) 

if  (deer  <  (0.9  *  (du  -  dl))) 

dl  =  dmp; 
dlx  =  dfune; 

} 

else 
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i 

dinpu  =  drop; 

drop  =  5.0  *  (dmp  -  dl)  +  dl; 
dfunc  =  Ix(dm,  dn,  dmp)  -  dp; 
if  (dlune  ==  0.0) 
flag  =  TRUE; 
if  (‘flag) 

{ 

if  (dfune  <  0.0) 

dl  =  dmp; 
dlx  =  dfune; 

> 

else 

du  =  dmp; 
dux  =  dfune; 
dl  =  dmpu; 
dlx  =  dfunCS] ; 

> 

} 

> 

} 

else 

{ 

if  (deer  >=  (0.1  ♦  (du  -  dl))) 

{ 

du  =  dmp; 
dux  =  dfune; 

} 

else 

■[ 

dmpu  =  dmp ; 

dmp  =  du  -  5.0  •  deer; 
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dfune  =  Ix(dm,  dn,  dmp)  -  dp; 
if  (dfune  ==  0.0) 
flag  =  TRUE; 
if  (!flag) 

{ 

if  (dfune  <  0.0) 

du  =  dmpu; 
dux  =  dfunCS] ; 
dl  =  dmp; 
dlx  =  dfune; 

> 

else 

< 

du  =  dmp; 
dux  =  dfune; 

} 

> 

} 

} 

} 

} 

} 

} 

return  (dmp) ; 

} 
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/•*«*********«»****«»***»«*»»»»»*»*****»»*«r»*«*»***»«»4>» 

•*  DATE:01/16/1992  *» 

••  VERSION;  1.0  •* 

**  TITLE:  Coefficients  file  ** 

**  FILENAME:  coefs.c  ** 

**  COORDINATOR:  Salah  Amin  Eleva  ** 

♦*  PROJECT : Development  of  em  Environment  for  Software  ** 
*♦  Reliability  Model  Selection.  *♦ 

**  OPERATING  SYSTEM:  MS  DOS  version  2.3  or  higher  *♦ 

♦*  LANGUAGE:  Turbo  C  (2.1)  ** 

»*  FILE  PROCESSING;  Compile  and  link  with  files  pms.c  ♦♦ 
••  compute. c,  prep.c,  and  prob.c.  *♦ 

CONTENTS;  ** 

1.4.1  -  Ri_Coef()  ♦» 

**  1.4.2  -  q_Coef()  ** 

•*  1.4.3  -  Ar_Coef()  •* 

*•  1.4.4  -  Create_Dir()  *• 

••  1.4.5  -  Create_Cir()  *♦ 

**  1.4.6  -  Bern_Poly()  '  ** 

**  1.4.7  -  Bern_Num()  ** 

♦♦  1.4.8-  com()  *♦ 

FUNCTION;  This  file  includes  the  routines  used  for  •* 

creating  the  different  coefficients  needed  by 
*♦  the  environment.  ♦♦ 

************** *****»*********«*4r***********************/ 

^include  <math.h> 

^include  "defs.h" 


boolean  bflag  =  FALSE; 
double  ka[MAX_SAMPLES  +  l] ; 

double  Ri[DATA_FILES  +  1],  Ar [DATA.FILES  +  l] ; 

void  Ar_Coef (double,  double); 

void  Ri_Coef (double ,  double,  double,  double); 
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static  double  comCint,  int); 

static  double  Bern_Poly(int,  double); 

static  double  q[DATA_FILES+l] .barray [DATA_FILES+2] ; 

static  double  Cir [DATA.FILES  +  l] [DATA. FILES  +  l]  ; 

static  double  Dir [DATA.FILES  +  l] [DATA.FILES  +  1]; 


z***************************** ***«*»•«*»»***»••*•******* 

*•  DATE:  01/16/1992  *• 

♦♦  VERSION:  1.1  •• 

♦♦  MODULE  NAME:  Ri_Coel()  ** 

**  MODULE  NUMBER:  1.4.1  ** 

**  DESCRIPTION:  This  module  is  used  for  creating  the  *• 

. **  Ri  coefficients  needed  by  Process_Equal  and 

**  Process_Unequal  in  table. c  and  Prob()  module  *» 

**  PASSEID  VARIABLES:  p, delta, a, v  ** 

•*  RETURNS: None  *• 

*♦  GLOBAL  VARIABLES  USED:  qG  ,  DirG,  RiG,  DATA.FILES** 

•»  GLOBAL  VARIABLES  CHANGED:  RiG  •* 

**  FILES  READ:  None  *• 

*♦  FILES  WRITTEN:  None  »* 

•*  HARDWARE  INPUT:  None  ** 

**  HARDWARE  OUTPUT:  None  •• 

**  MODULES  CALLED:  Create^DirO ,  q_Coef()  *• 

*♦  CALLING  MODULES:  Process.Equal  and  Process_Unequal  »* 

•*  in  table. c  and  Compute_Percentile()  ** 

**  AUTHOR:  Salah  A.  Eleca  ** 

**  HISTORY:  *• 

♦♦  1.0  Capt.  K.  N.  Cole  08/05/1986  *♦ 

•*  Translated  from  Pascal  code  *♦ 

*♦  (Original  by  Capt.  Mark  Amell)  *» 

*♦  1.1  Salah  A.  Elewa  01/16/1992  ** 

•*  Header  modified,  module  names  changed  ** 

***•«*••*********«**•***••***•••***•****«*«***••**•*•**/ 
void  Ri_Coef (double  p,  double  delta,  double  a.  double  v) 
{ 

void  q_Coef (double ,  double); 

void  Create_Dir (double,  double); 

double  sum; 

int  i,  k; 
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Create_Dir(a,  v); 
q_Coef(p,  delta); 

Ri[0]  =  1.0; 

for  (i  =  1;  i  <=  DATA_FILES;  i++) 

{ 

for  (sum  =  0.0,  k  =  1;  k  <=  i;  k++) 

sum  =  sum  +  Ri[i  -  k]  *  DirCi  -  k]  [k]  ; 
Ri[i]  =  (q[i]  -  sum)  /  Dir[i][0]; 

> 

return; 
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/**»*«*»***i»******:»***«4i*********«******»*»*»****»**«**» 

»*  DATE:  01/16/1992  ** 

•*  VERSION:  1.1  ♦* 

**  MODULE  NAME:  q_Coef()  •* 

**  MODULE  NUMBER:  1.4.2  *♦ 

**  DESCRIPTION: This  module  is  used  ior  calculating  the** 

.  **  q  coeliicients  for  module  Ri_Coef  ** 

*•  PASSED  VARIABLES:  p, delta  ** 

**  RETURNS  .-None  ** 

*•  GLOBAL  VARIABLES  USED:  Ar[3,  qG,  DATA.FILES  ** 

*•  GLOBAL  VARIABLES  CHANGED:  qG  ** 

**  FILES  READ:  None  ** 

**  FILES  WRITTEN:  None  ** 

**  HARDWARE  INPUT:  None  ** 

*♦  HARDWARE  OUTPUT:  None  ** 

*•  MODULES  CALLED:  Ar.CoefO  ** 

*•  CALLING  MODULES:  Ri.CoefO  ** 

**  AUTHOR:  Salah  A.  Elewa  ** 

**  HISTORY:  '  ** 

**  1.0  Capt.  K.  N.  Cole  08/05/198S  ** 

**  Treinslated  from  Pascal  code  ** 

**  (Original  by  Capt.  Mark  Amell)  ** 

**  1.1  Salah  A.  Eleua  01/16/1992  ** 

*♦  Header  modified,  module  names  chauiged  ** 

m0*********^i*****************************»******t******:/ 

void  q_Coef (double  p,  double  delta) 

{ 

int  i,  k; 
double  sum; 


Ar_Coef(p,  delta); 
q[0]  =  1.0; 

for  (i  =  1;  i  <=  DATA_FILES;  i++) 

{ 
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for  (sub  =  0.0,  k  =  1;  k 
sum  =  sum  +  k  ♦  Ar[k3 
q[i]  =  (1-0  /  (double)  i 

} 

return; 


<=  i;  k++) 
'  q[i  -  k]  : 
*  sum; 
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/***^*******#*******4i*****^***«*«*»******»******4>*****«<» 

*•  DATE:  01/16/1992  *♦ 

♦♦  VERSION:  1.2  •* 

♦*  MODULE  NAME:  Ar_Coef()  •* 

*•  MODULE  NUMBER:  1.4.3  •* 

•*  DESCRIPTION : This  module  is  used  for  calculating  the** 

**  Ar  coefficients  for  module  q_Coef  ** 

'**  PASSED  VARIABLES:  p, delta  ** 

**  RETURNS: None  ** 

**  GLOBAL  VARIABLES  USED:  ArC],  kaD,  DATA  .FILES  ** 

**  GLOBAL  VARIABLES  CHANGED:  Ar[]  ** 

**  FILES  READ:  None  ** 

**  FILES  WRITTEN:  None  ** 

**  HARDWARE  INPUT:  None  -  —  ** 

**  HARDWARE  OUTPUT:  None  ** 

**  MODULES  CALLED:  Bern.PolyO  ** 

**  CALLING  MODULES:  q.Coef  and  Process.Equal  and  ** 

**  Process.Unequal  in  table. c  ** 

**  AUTHOR:  Salah  A.  Elewa  ** 

**  HISTORY:  ** 

**  1.0  Capt.  K.  N.  Cole  01/12/1984  ** 

**  (Initial  Version)  ** 

**  1.1  Capt.  K.  N.  Cole  05/10/1985  ** 

**  Modified  for  new  formula  »* 

**  1.2  Salah  A.  Elewa  01/16/1992  ** 

**  Header  modified,  module  ncunes  chemged  ** 

,^t$ni»^t*»********9**»*****»***  **************  *****»»***»/ 

void  Ar.Coef (double  p,  double  delta) 

-[ 

double  factor,  partial; 
int  i,  k; 

Ar[0]  =1.0; 

factor  =  1.0; 
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for  (k  =  1;  y  <=  DATA.FILES;  k++) 

{ 

factor  =  factor  *  -1.0  /  p; 

for  (partial  =  0.0,  i  =  0;  i  <  p;  i++) 

partial=partial+Ben\_Poly(k+l,(delta*ka[i]-l))/cxp(log(ka[i])*k); 
ArCk]  =(factor/(double)(k*(k+l)))*(partial-Bern_Poly(k+l , (delta-1))) 

> 

return: 

> 


C-59 


/*«•******•***»***••*•**•»***••*•*••••*»•«*•»»»•**•***** 

**  DATE:  01/16/1992  *♦ 

*•  VERSION;  1.2  »♦ 

**  MODULE  NAME:  Create_Dir()  ** 

*•  MODULE  NUMBER:  1.4.4  •* 

*♦  DESCRIPTION ; This  module  is  used  for  creating  the  »* 

•  *♦  Dir  coefficients  for  module  Ri_Coef  ♦♦ 

••  PASSED  VARIABLES:  a.v  *♦ 

**  RETURNS: None  ♦* 

**  GLOBAL  VARIABLES  USED;  CirC],  Dir[].  DATA_FILES  •* 

•*  GLOBAL  VARIABLES  CHANGED:  Dir[]  *• 

FILES  READ:  None  •* 

**  FILES  WRITTEN;  None  •• 

•*  HARDWARE  INPUT;  None  ** 

•*  HARDWARE  OUTPUT;  None  ** 

**  MODULES  CALLED:  Create_Cir()  *• 

•  *  CALLING  MODULES:  Ri.CoefO  »* 

♦*  AUTHOR:  Salah  A.  Eleva  ** 

••  HISTORY:  ’  ** 

*♦  1.0  Capt.  Mark  F.  Amell  01/12/1984  ** 

*♦  (Initial  Version) 

•*  1.1  Capt.  K.  N.  Cole  05/10/1985  »♦ 

**  Header  added  ** 

•*  1.2  Salah  A.  Elewa  01/16/1992  *♦ 

♦♦  Header  modified,  module  names  changed  ** 

•  ***«***«********************i|i**»*****4t4i*»»**»******4,**/ 

void  Create.Dir (double  a,  double  v) 

{ 

void  Create_Cir (double ,  double); 
int  r,  i,  k; 
double  sum; 


Create_Cir (a ,  v) ; 

for  (i  =  0;  i  <=  DATA_FILES;  i++) 
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Dir[i]  [0]  =  1.0; 

for  (r  =  1;  r  <=  DATA.FILES;  r++) 

for  (i  =  0;  i  <=  DATA.FILES;  i++) 

for  (sum  =  0.0,  k  =  1;  k  <=  r;  k++) 

sum  =  sum  +  k  *  Cir[i][k3  •  Dir[i][r  -  k]  ; 

Dir[i]  [r]  =  sum  /  (double)  r; 

} 

> 

return ; 
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/*♦*♦*♦****♦•*♦********•♦•***•♦•****•*•»••••*•*•*•••***• 

••  DATE:  01/16/1992  ** 

**  VERSION:  1.2  •• 

•»  MODULE  NAME:  Create_Cir()  •* 

**  MODULE  NUMBER:  1.4.5  •* 

•*  DESCRIPTION: This  module  is  used  for  creating  the  •• 

Cir  coefficients  for  module  Create_Dir ()•* 

•*  PASSED  VARIABLES:  a.v  •* 

*•  RETURNS: None  *• 

**  GLOBAL  VARIABLES  USED:  Cir[],  DATA.FILES 
*♦  GLOBAL  VARIABLES  CHANGED:  CirG  •* 


•*  FILES  READ:  None 
•*  FILES  WRITTEN:  None 
♦♦  HARDWARE  INPUT:  None 


HARDWARE  OUTPUT:  None  •* 

•*  MODULES  CALLED:  Bern.PolyO  •* 

*♦  CALLING  MODULES:  Create_Dir()  •• 

•*  AUTHOR:  Salah  A.  Eleua  •* 

**  HISTORY:  .  •• 

•*  1.0  Capt .  Mark  F.  Amell  01/12/1984  *• 

**  (Initial  Version)  ** 

**  1.1  Capt.  K.  N.  Cole  05/10/1985  *• 

Header  added  ** 

*♦  1.2  Salah  A.  Elewa  01/16/1992  ** 

**  Header  modified,  module  names  changed  ♦* 


^**m***»*************»»*************»**»***********»***/ 

void  Create_Cir (double  a,  double  v) 

{ 

int  r ,  i ,  rt ; 
double  sign,  temp; 

for  (i  =  0;  i  <=  DATA.FILES;  ++i) 

Cir [i]  [0]  =  1.0; 
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lor  (sign  =  1.0.  r  =  1;  r  <=  DATA.FILES;  ++r) 

< 

rt  =  r  +  1 ; 

temp  =  Bern_Poly (rt .  a); 

lor  (i  =  0;  i  <=  DATA.FILES;  ++i) 

Cir[i] [r]=(sign/(r*(r+1.0)))*(temp-Bern_Poly(rt,a+v+i)) 

sign  =  sign  *  (-1.0) ; 

} 

return ; 

> 
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/**♦»******•*****•»»••*•*•♦»•♦»♦♦»*♦♦♦**»**♦*♦*****•**♦* 

**  DATE:  01/16/1992  *• 

*♦  VERSION:  1.1  ** 

**  MODULE  NAME:  Bern.PolyO  *♦ 

*♦  MODULE  NUMBER:  1.4.6 

DESCRIPTION :This  module  is  used  for  creating  the  ** 

. **  Bernoulli  polynomials  *♦ 

♦*  PASSED  VARIABLES:  n.x  *• 

**  RETURNS :Bern_Poly  (double)  •* 

**  GLOBAL  VARIABLES  USED:  barrayC]  *♦ 

*♦  GLOBAL  VARIABLES  CHANGED:  None  *♦ 

*♦  FILES  READ:  None  •* 

♦♦  FILES  WRITTEN:  None  •* 

*•  HARDWARE  INPUT:  None  *♦ 

**  HARDWARE  OUTPUT:  None  »• 

**  MODULES  CALLED:  Bern_Num(),  com()  *• 

•  *  CALLING  MODULES:  Ar.CoefO,  Create_Cir()  •* 

*•  AUTHOR:  Salah  A.  Elewa  ** 

•*  HISTORY:  ** 

♦*  1.0  Capt.  K.  N.  Cole  08/05/1985  •* 

•*  Translated  from  Pascal  code  ** 

(Original  by  Capt.  Mark  Amell)  •* 

1.1  Salah  A.  Elewa  01/16/1992  *» 

*♦  Header  modified,  module  name  changed  •* 

»**«***%******************************»********»*****4[*/ 

double  Bern_Poly ( int  n,  double  x) 

■C 

void  Bern_Num(void) ; 

int  i ; 

double  sum,  power; 


sum  =  0.0; 
power  =  1.0; 
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If  Cbflag) 

{ 

bflag  =  TRUE; 

Bern_Nuin();  /*  initialize  barray  */ 

} 

for  (i  =  n;  i  >=  0;  i — ) 

{ 

sum  =  sum  +  com(n,  i)  *  barrayCi]  *  power 
power  =  power  *  r; 

} 

return  (sum); 
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/***«****»**«**•»•*********«»*»*«**«>»****»*******»»»***• 

*»  DATE;  01/16/1992  *• 

••  VERSION;  1.1  ** 

♦  *  MODULE  NAME;  Bern_»uin()  *♦ 

*•  MODULE  NUMBER;  1.4.7  •• 

**  DESCRIPTION ; This  module  calculates  the  Bernoulli  ** 

•  •»  numbers  and  stores  them  in  array  (barray)** 

•*  PASSED  VARIABLES:  None  ** 

**  RETURNS; None 

*♦  GLOBAL  VARIABLES  USED;  barrayG,  DATA.FILES  ♦* 

••  GLOBAL  VARIABLES  CHANGED:  barrayG  ** 

**  FILES  READ:  None  •* 

*♦  FILES  WRITTEN:  None  __  *• 

»•  HARDWARE  INPUT;  None  ♦* 

••  HARDWARE  OUTPUT:  None  *• 

**  MODULES  CALLED:  comO  *• 

♦  *  CALLING  MODULES;  Bern.PolyO  ♦* 

**  AUTHOR:  Salah  A.  Eleua  ** 

•*  HISTORY:  '  ** 

*♦  1.0  Capt.  K.  N.  Cole  08/05/1985  ** 

*♦  Translated  from  Pascal  code  *• 

**  (Original  by  Capt.  Mark  Amell)  ** 

♦  ♦  1.1  SalzLh  A.  Elewa  01/16/1992 

*♦  Header  modified,  module  neune  changed  ** 

**********«**********4>*********«***>)i*******«******»****/ 

void  Bern_Num( void) 

double  sum; 
int  i,  j; 


baa-ray  [0]  =  1.0; 

for  (j  =  1;  j  <=  (DATA.FILES  l);  j-t-+) 

{ 

sum  =  0.0; 
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for  (i  =  0;  i  <=  (j  -  1);  i++) 

sum  =  sum  +  com(j  +  1,  i)  *  barray[i]; 
barray[j]  =  (-1.0  ♦  sum)  /  (j  +  1); 

} 

lor  (j  =  1;  j  <=  (DATA.FILES  +  1);  j++) 

{ 

if  ((barray[j]<  0. 0000001 )ftA(barray[j]>  -0.0000001)) 


barrayCj]  =  0.0; 


} 


return; 

} 
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*•  DATE;  01/16/1992  *• 

*♦  VERSION;  1.1  ♦♦ 

*•  MODULE  NAME;  comO  ♦* 

•*  MODULE  NUMBER;  1.4.8  ♦* 

*♦  DESCRIPTION ; This  module  calculates  the  number  of  ** 

*♦  possible  combinations  ♦* 

**  PASSED  VARIABLES;  n.i  *• 

*♦  RETURNS; com  (double)  ♦* 

GLOBAL  VARIABLES  USED;  None 

*♦  GLOBAL  VARIABLES  CHANGED;  None  *» 

*♦  FILES  READ;  None  *• 

♦♦  FILES  WRITTEN;  None 

**  HARDWARE  INPUT;  None  .  ...  »• 

♦♦  HARDWARE  OUTPUT;  None  ** 

♦♦  MODULES  CAL'  0;  None  ♦* 

•*  CALLING  MODULES;  Bern_Num(),  Bern_Poly()  ** 

♦*  AUTHOR:  Salah  A.  Elewa  ** 

-<♦  HISTORY;  •• 

*♦  1.0  Capt.  K.  N.  Cole  08/05/1985  *• 

**  Translated  from  Pascal  code  *♦ 

♦♦  (Original  by  Capt.  Hark  Amell)  *• 

*♦  1.1  Salah  A.  Eleoa  01/16/1992  •* 

**  Header  modified,  module  name  changed  *• 

double  comCint  n,  int  i) 

{ 

double  prod,  fn,  fi,  fj; 


f  n  =  n ; 
fi  =  i; 
f_  =  fn  -  fi; 
prod  =  1.0; 
while  (fi  >  0.0) 
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{ 

prod  =  prod  ♦  (in  /  fi); 
f n  =  in  -  1.0; 
fi  =  fi  -  1.0; 

} 

vhile  (ij  >  0.0) 

{ 

prod  =  prod  *  (In  /  Ij); 
f n  =  f n  -  1.0; 

Ij  =  fj  -  1.0; 

} 

return  (prod) ; 
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/^i^*^tl^*t^^^^***‘^^***********<^**********  *************  ******* 

**  DATE:  01/16/1992  *• 

*»  VERSION:  1.0  •* 

♦*  TITLE:  Percentile  Points  File  ** 

**  FILENAME:  table. c  *» 

**  COORDINATOR:  Salah  Amin  Elewa  ** 

♦*  PROJECT: Development  oi  an  Environment  for  Software  ** 

*•  Reliability  Model  Selection.  ** 

**  OPERATING  SYSTEM:  MS  DOS  version  2.3  or  higher  •* 

**  LANGUAGE:  Turbo  C  (2.1)  ** 

FILE  PROCESSING:  Compile  and  link  with  files  Prob.c** 
*♦  and  coefs.c  •* 

•*  CONTENTS:  ** 

**  1.0-  mainO  *♦ 

••  1.0.1  -  Get_Data()  ** 

**  1.0.2  -  Process_Equal()  •• 

♦*  1.0.3  -  Process-Unequal 0  ** 

1.0.4  -  Print_Header()  ** 


FUNCTION:  The  modules  in  this  file  get  information  ** 

**  about  calculation  method,  whether  failures  cire»» 

equal  or  unequal,  the  number  of  samples,  cmd  ** 

*♦  number  of  failures  then  a  table  of  percentage  ** 

♦*  points  at  various  significance  levels  and  var-** 

**  ious  total  number  of  failures  is  then  produced** 

********************************************************/ 

^include  <stdlib.h> 

#include  <stdio.h> 

Sinclude  <conio.h> 

#include  <math.h> 

^include  "defs.h" 

extern  void  Ar.Coef (double,  double); 

extern  void  Ri_Coef (double ,  double,  double,  double); 

extern  double  Neuton(double ,  double,  double,  double,  int ,  double,  double) 
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extern  double 


ArG: 

extern  boolean  exact; 
extern  double  ka[] ; 


static  double  p; 

static  boolean  equal; 

.static  int  k,  RIHI,  RING; 

static  FILE  *fp6; 

static  double  alpha_i [MAX_ALPHA3  = 

{  /*  These  values  can  be  changed  in  the  defs.h  file  ♦/ 

#ifdef  ALPHAl 
ALPHAl, 

#endif 


#ifdef  ALPHA2 
ALPHA2, 
#endif 

#ifdef  ALPHAS 
ALPHAS, 
#endif 

#ifdef  ALPHA4 
ALPHA4, 
#endif 

#ifdef  ALPHAS 
ALPHAS. 
#endif 
}; 
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»*  DATE:  01/16/1991 


*•  VERSION:  1.0 


**  MODULE  NAME:  main 


**  MODULE  NUMBER:  1.0 


*♦  DESCRIPTION:  This  main  program  in  lor  percentage  *♦ 


points  generation 


**  PASSED  VARIABLES:  None 


*♦  RETURNS:  None 


♦♦  HARDWARE  INPUT:  None 


♦♦  HARDWARE  OUTPUT:  None 


♦*  MODULES  CALLED:  Get_Data() 


Process_Equal ( ) 
Process_Unequal() 


**  CALLING  MODULES:  None 


♦*  AUTHOR:  Salah  Amin  Elewa 


HISTORY: 


1.0  Salah  Amin  Elena  01/16/1992 


original  version 


void  mainO 


void  Get_Data( void) ; 


void  Process_Equal(void) ; 
void  Process_Unequal(void) ; 


clrscr () 


Get_Data( ) ; 


il  (equal) 

Process_Equal() , 


Process_Uriequal()  ; 
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**  DATE:  01/16/1992  *♦ 
**  VERSION:  1.0  ** 
*♦  MODULE  NAME:  Get_Data()  ♦♦ 
**  MODULE  NUMBER:  1.0.1 


*♦  DESCRIPTION:  This  module  is  used  for  obtaining  inf-** 
**  ormation  about  the  number  of  failures  in  dif-** 
**  ferent  samples  whether  equal  or  unequal,  the  ** 


**  required  accuracy  of  calculations  whether  ** 

**  exact  or  asymptotic  and  the  initial  and  inc-  ** 

**  remental  number  of  failures.  ** 

**  PASSED  VARIABLES:  None  ** 

**  RETURNS:  None  _  ** 

•*  GLOBAL  VARIABLES  USED:  exact,  equal,  p.  RINI,  RING  ** 

**  GLOBAL  VARIABLES  CHANGED;  exact,  equal  *• 

**  FILES  READ:  None  ** 

**  FILES  WRITTEN:  None  *« 

**  HARDWARE  INPUT:  Keyboard  ** 

*•  HARDWARE  OUTPUT:  Screen  '  ** 

**  MODULES  CALLED:  None  »* 

**  CALLING  MODULES:  The  main  program  ** 

**  AUTHOR:  Salaih  A.  Elewa  ** 

HISTORY:  ** 

**  1.0  Salah  A.  Elewa  01/16/1992  ** 

**  original  version  ** 


«•****«**«**••••****••*«***#•******•***•*»*****»»*»*•**/ 

void  Get_Data(void) 

{ 

char  ch; 

puts("\n\n\t  Enter  (E)qual  (e)  OR  (U)nequal  (u)  Calculations  ? 
for  ( ; ; ) 

{ 

ch  =  getche( ) ; 
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if  (ch  ==  'u'  II  ch  ==  ’U’) 

i 

equal  =  FALSE; 
print! ("nequalXn") ; 

> 

else  if  (ch  ==  'e'  I  I  ch  ==  ’E’) 

{ 

equal  =  TRUE; 
print! ("qual\n") ; 

> 

else 

{ 

print!  ("\n\t\t\t  Sorry!  7,c  is  Unknoun  Choice",  ch); 
puts("\n\t\t\t  Try  Again  OR  Press  Ctrl+BreaJt  to  Quit\n\n\n" ) ; 

} 

if  (ch  ==  ’u'  II  ch  ==  ’U’  II  ch  ==  ’e’  II  ch  ==  'E') 
break ; 

} 

puts("\n\n\t  Enter  (E)xact  (e)  OR  (A)symptotic  (a)  Calculations  ?") 
for  ( ; ; ) 

{ 

ch  =  getcheO  ; 

if  (ch  ==  'a'  II  ch  ==  ’A’) 

{ 

exact  =  FALSE; 
print! ("symptoticXn”) ; 

} 

else  if  (ch  ==  ’e’  II  ch  ==  ’E’) 

{ 

exact  =  TRUE; 
print! ("xactXn") ; 

} 

else 
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print!  (‘'\n\t\t\t  Sorry*  ’/.c  is  Unknown  Choice",  ch) ; 
puts("\n\t\t\t  Try  Again  OR  Press  Ctrl+Break  to  Ouit\n\n\n") ; 

} 

il  (ch  ==  'a'  li  ch  ==  'A'  II  ch  ==  ’e’  II  ch  ==  ’£’) 
break ; 

> 

puts("\n\n\t  Enter  Number  of  Samples  p?") ; 
scanfCy.lf".  fcp); 

puts("\n\n\t  Enter  Initial  Total  Number  of  Failures  RINI?"); 
scanf("y.d",  ftRlNI); 


puts("\n\n\t  Enter  Increment  to  Total  Number  of  Failures  RING?"); 
scanfCy.d",  tRINC) ; 


} 
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/*••♦*•»*****•»**»♦•***♦***•♦*•••••*•••**»»»*•♦»»♦♦•**♦♦ 

*♦  DATE:  01/16/1992  •* 

*♦  VERSION:  1.0  •• 

**  MODULE  NAME:  Process_Equal()  *♦ 

**  MODULE  NUMBER:  1.0.2  ** 

**  DESCRIPTION:  This  module  is  used  to  calculate  the  •* 

.  *♦  percentile  points  in  case  oi  equal  number  of  ♦♦ 

failures  in  each  sample.  ** 

*♦  PASSED  VARIABLES:  None 

♦*  RETURNS:  None  ** 

**  GLOBAL  VARIABLES  USED;  kaD ,Ar[] .p.RINI ,RINC  ♦♦ 

**  and  Alpha. i[]  ** 

**  GLOBAL  VARIABLES  CHANGED;  ka[],Ar[]  *♦ 

**  FILES  READ:  The  file  containing  the  failure  times 
♦»  or  the  times  between  failures  •* 

*•  FILES  WRITTEN:  "signific.dat"  file,  where  the  perc-*» 
**  entile  points  at  different  significance  level** 

**  and  different  failures  per  Scunple  are  printed** 

**  HARDWARE  INPUT:  None  ** 

**  HARDWARE  OUTPUT:  None  *• 

**  MODULES  CALLED;  Pr int.Header ( ) . Ar.Coef ( ) ,  Ri_Coef()*» 

**  and  NewtonO  »* 

**  CALLING  MODULES:  The  main  program  ** 

*•  AUTHOR;  Salah  A.  Elewa  ** 

**  HISTORY;  ** 

**  1.0  Salah  A.  Elewa  01/16/1992  ** 

**  original  version  ** 

*«••*♦*♦**»♦•♦•*•••••*•*»*••»•*•*»••»•••»*•*******•*•*»/ 
void  Process_Equal(void) 

{ 

void  Print.Header (void) ; 

int  i,  r,  R; 

double  rvalue,  v,  a,  t,  sum,  delta,  m; 
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if  ((fp6  =  fopenC'signif ic.dat" ,  "v"))  ==  NULL) 

< 

printfC'can  not  open  signific.dat  fileXn"); 
exit( 1) : 

> 

delta  =  0.0; 

Print.HeaderO  ; 
for  (i  =  0;  i  <  (int)  p;  i++) 
ka[i]  =  1.0  /  p; 

V  =  3.0  *  (p  -  1.0)  /  2.0; 
sum  =  0.0; 

for  (i  =  0;  i  <  (int)  p;  i++) 
sum  =  sum  +  (1.0  /  ka[i]); 
delta  =  (13.0  ♦  (sum  -  1.0))  /  ((p  -  1.0)  ♦  18.0); 
a  =  (1.0  -  v)  /  2.0; 
t  =  (p  +  1.0)  /  (6.0  *  p): 

Ri_Coef(p,  delta,  a,  v); 

for  (r  =  RINI;  r  <=  RINI  +  12  •  RING;  r  =  r  +  RING) 

{  /*  loop  through  r  values  •/ 

if  (r  <  ((int)  p  +  1)) 
r  =  (int)  (p  +  1.0); 
printf("\nl  r=*/.3d  I",  r); 

fprintf(fp6,  "\nl  r=y.3d  I",  r); 

R  =  r  •  (int)  p; 
m  =  ((double)  R  -  delta)  /  p; 

for  (k  =  0;  k  <  MAX_ALPHA  ftft  alpha_i[k]  >  0.0;  k++) 

{ 

rvalue  =  Hewton(a,  v,  t,  p,  R,  alpha_i[k],  m) ; 
printfC  '/.S.eif  I",  rvalue); 
fprintf(fp6,  "  '/.8.61f  I",  rvalue); 

> 

} 

printf  ("\n’ - ' - *  *  ") 

printf  ("  - ' - '\n'’)  ; 
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fprintf (fp6,"\n 
f print! (fp6 , " 
f close(lp6) ; 


**  DATE:  01/16/1992  *• 

VERSION:  1.0  *• 

♦♦  MODULE  NAME:  Process_Unequal ()  ♦* 

**  MODULE  NUMBER:  1.0.3 


♦*  DESCRIPTION:  This  module  is  used  to  calculate  the  *• 
*♦  percentile  points  in  case  of  unequal  number  of* 


•*  failures  in  each  sample.  ** 
*•  PASSED  VARIABLES:  None  ** 
**  RETURNS:  None  ** 
*•  GLOBAL  VARIABLES  USED:  kaD ,Ar □  .p.RINI ,RINC  *• 
**  and  Alpha_i[] ,k,MAX_ALPHA  *♦ 
**  GLOBAL  VARIABLES  CHANGED:  ka[].  Ar[]  ** 


**  FILES  READ:  The  file  ••ka2"  or  "ka3*'  (depending  on  •* 
**  the  number  of  samples).  These  files  contain  ** 
**  the  values  of  the  ka[]  coefficients.  Note  that* 
**  this  module  handles  t»o  cases  of  niimber  of  ** 
**  samples  but  can  easily  modified  (just  redraw  ** 
**  the  header)  to  handle  any  number  of  saunples.'  ** 
**  FILES  WRITTEN:  "signific.dat"  file,  where  the  perc-** 
**  entile  points  at  different  significance  level** 


**  and  different  values  of  ka[3  are  printed  *• 
**  HARDWARE  INPUT:  None  ** 
**  HARDWARE  OUTPUT:  None  ** 
**  MODULES  CALLED:  Print.Header () , Ar.Coef ( ) ,  Ri_Coef()** 
**  aind  NewtonO  ** 
**  CALLING  MODULES:  The  main  program  ** 
**  AUTHOR:  Salah  A.  Elewa  ** 
**  HISTORY:  ** 
**  1.0  Salah  A.  Elewa  01/16/1992  ** 
**  original  version  ** 
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void  Process_Unequal(void) 


FILE  *fplO; 
int  i,  j,  R; 

void  Print_Header (void) ; 

double  xvalue,  v,  a,  t; 
double  sun,  delta,  n; 

delta  =  m  =  0.0; 

if  ((lp6  =  fopenC'signific.daf ,  "u"))  ==  NULL) 

{ 

printfC’can  not  open  signific.dat  file\n"); 
exit( 1) ; 

> 

for  (k  =  0;  k  <  HAX.ALPHA  alpha_i[k]  >0.0;  k++) 

/♦  loop  through  alpha  values  */ 

Print.HeaderO : 
if  (p  <  2.9999) 

{ 

if  ((fplO  =  fopen(’'ka2",  ”r”))  ==  NULL) 

printf("\n  Can  NOT  Find  The  File  */,s\n’',  fplO); 
puts("\n  Enter  the  CORRECT  File  Nane  OR  Ctrl-C  to  Exit\n”); 

> 

} 

else 

{ 

if  ((fplO  =  fopenC'kad",  "r"))  ==  NULL) 

printf  (’'\n\t\t\t  Can  NOT  Find  The  File  V.sXn"  ,  fplO); 
puts("\n\t\t\t  Enter  the  CORRECT  File  Nane  OR  Ctrl-C  to  ExitXn")  ; 
} 
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} 

while  ( !f eof (fplO) ) 

{ 

if  (p  <  2.9999) 

■c 

fscanf  (fplO,  "'/.If  ‘/.If  tkaCO],  tka[l]); 
printf("iy.2.2f  l*/.2.21f  I",  kaCO],  ka[l]): 
fprintf(fp6.  "  r/.2 . 2f  I  y.2 . 21f  1 " .  ka[0]  ,  ka[l3); 

> 

else 

fscanf  (fplO,  •••/.If  ‘/.If  '/.If  ••.  ftka[0],  ftka[l]  ,  tka[2]); 
printf  (•'r/.2.2f  |•/.2.21f  |•/.2.2f  f.  ka[03  .  ka[l].  ka[2]); 
fprintf(fp6.  ••r/.2.2f  |•/.2.21f  |•/.2.2f  !••.  ka[0]  ,  ka[l]  ,  ka[2]): 

> 

V  =  3.0  *  (p  -  1.0)  /  2.0; 
sum  =  0.0; 

for  (i  =  0;  i  <  (MAX.SAMPLES  +  1)  bit  ka[i]  >  .0000001;  i++) 
sum  =  sum  +  (1.0  /  kaCi]); 
delta  =  (13.0  ♦  (sum  -  1.0))  /  ((p  -  1.0)  ♦  18.0); 
a  =  (1.0  -  v)  /  2.0; 
t  =  (p  +  1.0)  /  (6.0  *  p); 

Ri_Coef(p,  delta,  a,  v) ; 
for  (j  =  1;  j  <=  5;  j++) 

{ 

R  =  RINI  +  (j  -  1)  *  RING; 
m  =  ((double)  R  -  delta)  /  p; 
if  (ka[0]  *  R  >  2.99999999) 

{ 

rvalue  =  Neuton(a,  v,  t,  p,  R,  alpha_i[k].  m) ; 
printf (••  '/.S.eif  !••.  rvalue); 
fprintf(fp6,  •'  '/.8.61f  !•',  rvalue); 

> 

else 
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{ 

printfC"  I"); 

fprintf(fp6,  '•  I"); 

} 

}  /*  loop  through  fail  values  */ 

print! ("\n") ; 
lprintf(fp6,  *‘\n"); 

} 

if  (p  <  2.99999) 

{ 

printfC"  ' - ' - ^ - ' - ' -  '■): 

print!  (" - ' - * - *  \n")  ; 

fprintf  (fp6."  ' - ■ - ■ - ' - ' — ") ; 

fprintf  (fp6  ,  " - ' - ' - ^ — *  \n")  ; 


} 

else 

< 

printfC"  ' - > - ' - ' - 1 - 1 - ") ; 

print! (" - ' - ' - '  \n")  ; 

fprintf  (fp6,"  ’ - ' - * - ^ ' - ") ; 

fprintf  (f  p6  ,  "  — ^ - * - ' - '  \n")  ; 

> 

print!  ("\n\n\n'')  ; 
fprintf (fp6,  "\n\n\n"); 

} 

f close(fplO) ; 
f close(fp6) ; 
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*»  DATE:  01/16/1992  *» 
**  VERSION:  1.0  ♦* 
»•  MODULE  NAME:  Pri)n.t_Header ()  ** 
**  MODULE  NUMBER:  1.0.4  *♦ 


*•  DESCRIPTION:  This  module  is  used  for  printing  the 
♦  •  table  header  both  on  the  screen  cind  the  file  *• 


**  ncuned  signific.dat  •* 

**  PASSED  VARIABLES:  None  ♦♦ 

•*  RETURNS:  None  ** 

**  GLOBAL  VARIABLES  USED:  exact,  equal,  k,  p.  RINI.  *• 

♦»  RINC,alpha_i  ** 

GLOBAL  VARIABLES  CHANGED:  None  •• 

FILES  READ:  None  *♦ 

**  FILES  WRITTEN:  "signific.dat"  file 

*•  HARDWARE  INPUT:  None  ** 

»*  HARDWARE  OUTPUT;  None  •* 

**  MODULES  CALLED:  None  ** 

*»  CALLING  MODULES:  The  main  program  ** 

AUTHOR:  Salah  A.  Elewa  •» 

•*  HISTORY:  *» 

*♦  1.0  Salah  A.  Elewa  01/16/1992  *♦ 

♦*  original  version  ** 


♦»*♦♦*♦*♦♦****♦**♦♦♦•*»♦*♦♦»♦*»*♦*♦♦***♦♦***♦♦**••*•*•*/ 

void  Print_Header (void) 

{ 

clrscr ( ) ; 
if  (equal) 

{ 

printf("\n  Percentage  Points  of  L=  *(p/R)  with  Equal  Scunple  Sizes"); 
fprintf (fp6,"\n  Percentage  Points  of  L=  ‘(p/R)  with  Equal  Sample  Sizes"); 
} 

else 

{ 
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print! ("\n  Percentage  Points  of  L=  *(p/R)  with  Unequal  Scunple  Sizes"); 
fprintf(fp6,  "\n  Percentage  Points  of  L=  "(p/R)  with  Unequal  Sample 
Sizes" ) ; 

} 

if  (exact) 

{ 

printf("\n\t  Exact  Method  is  used  for  Calculations"); 
fprintf(fp6,  "\n\t  Exact  Method  is  used  for  Calculations"); 

} 

else 

{ 

printf("\n\t  Asymptotic  Method  is  used  for  Calculations"); 
fprintf(fp6,  "\n\t  Asymptotic  Method  is  used  for  Calculations"); 

> 

print!  ("\n\t\t  Number  of  samples  =  */,d\n"  ,  (int)  p)  ; 
fprintf(fp6,  "\n\t\t  Number  of  samples  =  */.d\n" ,  (int)  p)  ; 
if  (equal) 

{ 

print! ("  , - - - - -  ")  ; 

printfC  - 1  \n"); 

printf("l  Failures  l\t\t\t  Level  of  Significance  o(' \t  |\n"); 

printfC'l  I - , - 1 - i - "); 

printfC  “1 - 1  \n")  ; 

printfC'l  Per  Sample  I  0.100  I  0.050  I  0.025  I  0.010  "); 

printfC  I  0.005  l\n"); 

printfC'l - 1 - 1 1 1 -  "); 

printfC  H - 1  "); 

f print!  (f  p6 ,  "  ^ - , - " ) ; 

f  print!  (fp6 , " - 1  \n")  ; 

fprintf (fp6 , " I  Failures  i\t\t\t  Level  of  Significance  o<'\t  |\n"); 

fprintf  (fp6,"|  | - j - 1 - 1 - "); 

fprintf  (fp6 ,  " - [ - |\n"); 
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fprintf (fp6."|  Per  Sample  I  0.100  I  O.OSO  I  0.025  I  0.010  "); 

fprintf (fp6 , "  I  0.005  l\n"); 

fprintf  (fp6.'' h  "  I - 1 - 1 - 1 - ")  ; 

fprintf (fp6."  - 1' .  ---I*'); 

} 

else 

{ 

if  (p  <  2.9999) 

{ 

printf  (•'  , - , - ••) ; 

printfC - |\n"); 

printf  ("  I '®^=  y.5.31fl\t\t  Total  number  of  Failures  R\t\t  |\n", 
alpha_i  [k] )  ; 

printf  ( ••  I - ; - 1 - , - , - ^ - T  •• )  ; 

printfC* - 1  \n"); 

printfC*  1  kl  I  k2  I  •/.2d  I  •/.2d  1**,  RINI,  RINI+RINC) ; 

printfC**  7.2d  I  •/.2d  I  •/.2d  |\n**,RINI+2*RINC, 

RINI+3*RINC.RINI+4*RINC); 

printfC**! - 1 - 1 - 1 - 1 - 1 - 1-"): 

printfC" - 1  \n**); 

fprintf  Cf  p6 .  | - , - ** )  ; 

fprintf  Cfp6.*' - 1  \n'*) ; 

fprintfCfpS,  *'|‘o<=  7,5.31fl\t\t  Total  number  of  Failures  R\t\t  l\n*', 
alpha. i [k] )  ; 

fprintfCfp6,  "  | - 1 - 1 - 1 - 1 - , - **); 

fprintf  Cfp6,**  — I - i\n"); 

fprintf  Clp6.  "I  kl  I  k2  I  7.2d  I  •/.2d  I**,  RINI ,  RINI+RINC)  ; 

fprintf  Cfp6,  "  y.2d  I  y.2d  1  y.2d  1  \n"  .RINI+2+RINC , 

RINI  +  3*RINC,RINI+4*RINC)  ; 

fprintf Cfp6,  *'| - 1 - 1 - 1 - 1 - 1 - *’); 

fprintf  Cfp6,*' H - 1  \n'*): 

> 

else 
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printfC'i - ^ 

printf  (*' - 1  \n") ; 

printf("l  OC  =  y.5.31f  l\t\t  Total  number  oi  Failures  R\t  l\n", 

alpha_i[k]) ; 

printfC'i - 1 - \ - 1 - 1 - 1 - 1 - [- 

printf  ("  - l\n"); 

printfC'i  kl  I  k2  I  k3  I  7.2d  I  •/.2d  I",  RINI  ,RIHI+RIHC) ; 

printf  ("  V.2d  1  •/.2d  I  •/.2d  i  \n"  .RIMI+2*RIIIC . 


RINI+3*RI»C.RINI+4*RI1IC)  ; 


printf (" I 
printf (" 


\n"): 


f printf (fp6,"  j - 1 - 

f printf (fp6,"  - |\n"): 

fprintf(fp6,  "|  0<=  */,S.31f  l\t\t  Total  number  of  Failures  R\t 

alpha. i [k] ) ; 

fprintf(fp6.  "I - 1 - 1 - 1 - 1 - ] - [ 

fprintf  (fp6," — | - (\n"): 

f printf (fp6,"(  kl  I  k2  I  k3  I  7.2d  |  7.2d  I",  RINI, 

RINI+RINC); 

fprintf  (fp6,"  •/.2d  I  •/.2d  I  7.2d  |\n",RIllI+2*RIBC, 

RINI+3*RINC.RINI+4*RIHC) ; 


fprintf (fp6 , " 
fprintf (fp6," 


\n"); 
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.APPENDIX  D.  .4])plicaiwn  oj  tin  PMS  ou  Musa  and  Liitlcwood  Failure  Data  Sets 

Table  D.l  Data  Analvsis  of  Failure  Set  1 


Table  D.2  Data  Analysis  of  Failure  Set  2 
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Table  D.3  Data  Analvsis  of  Failure  Set  4 


i 

F.  Set  1 

0.00025 

SET.l 

N/-0.01 

L=0.895 

C=0.902 

SET.2 

N/-0.03 

L=0.804 

C=0.833 

SET.4 

SET.5 

N7-0.33 

L=0.649 

C=0.978 

SET.C 

Y/0.030 

L=0.886 

C=0.856 

SET.]  4c 

N7-0.77 

L=0.034 

C=0.802 

SET.17 

N7-0.25 

L=0.557 

C=0.806 

SETJ27 

N7-0.68 

L=0.135 

C=0.811 

SETJSla 

^7-0.78 

L=0.104 

C=0.8S9 

N7-0.61 

L=0.330 

C=0.943 

SET.SS3 

N7-0.64 

L=0.303 

C=0.943 

SET.SS4 

N7-0.75 

L=0.173 

C=0.925 

SET.Lt2 

N7-0.16 

L=:0.708 

C=0,869 

SET.Lt3 

Y/0.068 

L=0.996 

C=0.928 

Table  D.4  Data  Analysis  of  Failure  Set  5 


SET-Slc 


SET.SS3 


SET-SS4 


SET.Lt2 


SET-Lt3 


0  00023 


N/-0.98 

L=0.000 

C=0.980 


N/-0.28 

L=0.700 

C=0.978 


N7-0.33 

L=0.C49 

C=0.978 


N7-0.46 

L=0.517 

C=0.979 


Y/0.007 

L=0.984 

C=0.978 


N7-0.18 

L=0.79S 

C=0.978 


N7-0,0S 

L=0.899 

C=0.978 


V/0.012 

L=0,995 

C=0.9S3 


Y/O.OOG 

L=0,989 

C=0.983 


N/-0.10 

L=0.882 

C=0.9S1 


N7-0.37 

L=0.611 

C=0.979 


N7-0.98 

L=0.000 

C=0.9S2 


0.0005 


Significance  Level  a 


0.0025  0.005  .01 


Two  Identical  Sets  or  Set  Compared  with  Itself  L  =  1.0 


Y/O.OOl 

N7-0.00 

L=0.984 

L=0.984 

C=0.9S3 

C=0.985 

Y/0.013 

Y/0.011 

Y/0.009 

Y/0.008 

L=0.999 

L=0.999 

L=0.999 

L=0.999 

C=0.980 

C=0,98S 

C=0.990 

C=0.992 

Y/0.007  Y/0.006 

L=0.995  L=0.995 

C=0.987  C=0.98S  I  C= 


Y/0.005  Y/0.003  Y/0.002 

L=0.989  L=0.989  L=0.989 

C=0.984  C=0.985  C=0.987 
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Table  D.5  Data  Analysis  of  Failure  Set  6 


F.  Set 


SET-1 


0  OOO’Jo  I  0.00050 


Significance  Level  a 


0.00100  0.00250  0.00500 


0.0.5000 


SET.2 


SET-4 


SET.5 


N/-0.32 

1=0.538 

C=0.857 


^■/0.030 

1=0.886 


Y/0.020 

L=0.886 


C=0.85G  C=0.8G7 


SET.G 


SET.14C 

N7-0.82 

L=0.013 

C=0.S35 

SET.17 

1 

N7-0.51 

L=0.325 

C=0.83S 

SET.27 

N7-0.78 

L=0.060 

C=0.842 

SET-Sla 


N7-0.86 

L=0.043 

C=0.900 


Two  Identical  Sets  or  Set  Compared  with  Itself  L  =  1.0 


SET-SS3 


SET-SS4 


SET-Lt2 


SET-Lt3 


N/-0.77 

L=0.174 

C=0.946 


^7-0.85 
L=0  083 
C=0.930 


S/-0.42 

L=0.4G2 

C=0.885 


^7 

L= 

C= 
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Table  D. 6  Data  Analysis  of  Failure  Set  l^C 


Signtficancc  Levdu 


U.00025  O.OOOoO  0.00100  0.00250  0.00500  0.01000  0.02500  I  0.05000 


N7-0.85 

L=0.040 

C=0.892 


N/-0.73 

L=0.074 

C=0.804 


Y/0.007  Y/0.005 

1=0.984  L=0.984 

C=0.978  C=0.979 


N7-0.82 

L=0.013 

C=0.S35 


Twc 


N7-0.62 

L=0.145 

C=0.766 


N7-0.19 

L=0.579 

C=0.774 


Y/0.022 


SET-Slc 


SET.SS3 


Y/O.OlO 

L=0.916 

C=0.906 

Y/O.OOl 

L=0.916 

C=0.915 

iN7-0.0l 

L=0.91G 

C=0.925 

Y/0.017 

L=0.972 

C=0.954 

Y/0.013 

L=0.972 

C=0.959 

Y/0.008 

L=0.972 

C=0.9G4 

Y/0.002 

L=0.972 

C=0.970 

.N/-0.00 

L=0.972 

0=0.975 

Table  D.T  Data  Analysis  of  Failure  Set  17 


Significance  Level  a 


F.  Set 

0.00100 

0.00250 

0.00500 

O.OIGOO 

0.02500 

0.05000 

SET-1 

N/-0,01 

L=0.8S0 

C=0.894 

H 

SET-2 

Y/0.029 

L=0.881 

C=0.653 

Y/0.015 

L=0.881 

C=0.867 

N7-0.00 

L=0.881 

C=0.881 

i\7-0.25 

L=0.557 

C=0.80G 

SET-5 

N7-0.18 

E=0.798 

C=0.978 

SET-6 

N/-0.51 
L=0.325 
C=0  838 

,  - 

SET-Hc 

SET.17 

Two  Identical  Sets  or  Set  Compared  w 

til  Itself  L  =  1.0 

SET.27 

SET-Sla 

N7-0,60 

L=0.278 

C=0.87S 

WM 

SET-SS4 

^7-0.5G 

L=0.3G4 

C=0.920 

SET-Lt2 

Y/0.09S 

L=0.962 

C=0.864 

Y/0.087 

L=0.9C2 

C=0.875 

Y/0.073 

L=0.9G2 

C=0.889 

Y/0.0G2 

L=0.962 

C=0.900 

SET-L13 

Table  D.8  Data  Analysis  of  Failure  Set  27 


F.  Set 

Significance  Level  a 

0.00025 

0.00050 

0.00100 

0.00250 

0.02500 

0.05000 

N7-0.6S 

L=0.211 

C=0.895 

SET-2 

N7-0.53 

L=0.282 

C=0.S13 

SET-5 

N/-0.0S 

L=0,899 

C=0.978 

SET-C 

■ 

■ 

. 

SET.14C 

i\7-0.19 

L=0.579 

C=0.774 

SET-17 

N7-C,33 

1=0.448 

C=0.779 

SET-27 

Two  Identical  Sets  or  Set  Compared  with  Itself  L  =  1.0 

.N7-0.32 

L=0.558 

C=0.8S0 

SET-Slc 

■ 

SET-SS3 

b7-0.22 

L=0.722 

C=0.941 

SET_SS4 

N/-C.36 

L=0.5C4 

C=0.921 

SET-Lt2 

N/-0.51 

L=0.350 

C=0.857 

SET_Lt3 

N7-0.83 

L=0.097 

C=0.924 
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Table  D.9  Data  Analysis  of  Failure  Set  SSla 


F.  Set 

Signtficaiict  Level  a 

0  0U025 

0.00050 

0.00100 

0.00250 

0.00500 

0.05000 

SET.l 

N7-0.92 

L=0.000 

C=0.925 

SEl-2 

N7-0.73 

L=0.157 

C=0.889 

SEl.-l 

■ 

SET-5 

V/0.020 
L=0.999 
C=0  980 

Y/0.018 
L=0  999 
C=0.981 

Y/0.017 

L=0.999 

C=0.983 

Y/0.015 

L=0.999 

C=0.985 

Y/0  013 
L=0.999 
C=0.986 

Y/0. Oil 
L=0.999 
C=0.988 

Y/0. 009 
L=0.999 
C=0.990 

SET-6 

N7-0.80 

L=0.043 

C=0.900 

SET-14C 

V/0.040 

1=0.916 

C=0.876 

Y/0.031 

L=0.916 

C=0.885 

Y/0.022 

L=0.916 

C=0.894 

Y/0. 001 
L=0.916 
C=0.915 

N7-0.01 

L=0.916 

C=0.925 

SET-17 

,N7-0.60 

L=0.278 

C=0.S78 

SET-27 

N7-0.32 

L=0.55S 

0=0,880 

_ 

SET-SI  a 

Two  Identical  Sets  or  Set  Compared  wi 

th  It.self  L  =  1.0 

SET-Slc 

V/0.040 

L=0.991 

C=0.952 

Y/0,036 

E=0.991 

C=0.955 

Y/0.032 

L=0.991 

C=0.959 

Y/0.027 

L=0.99l 

C=0.964 

Y/0.C24 

L=0.991 

C=0.9C7 

Y/0.020 

L=0.991 

C=0,971 

Y/0.015 

L=0.99l 

C=0.97C 

Y/0. on 
L=0.991 
C=0.980 

SET.SS3 

't70.0-lD 

L=0.992 

C=0.952 

Y/0.037 

L  =  0.992 
C=0.955 

Y/0.033 

L=0.992 

C=0.959 

Y/0.028 

L=0.992 

C=0.964 

Y/0. 025 
L=0.992 
C=0.9G7 

Y/0. 021 
L=0.992 
C=0.971 

Y/0. 016 
1=0.992 
C=0.976 

Y/0. 012 
L=0.992 
C=0.980 

SET-SS4 

N7-0.0G 

L=0.8f4 

C=0.939 

SE1-Lt2 

N7-0.79 

L=0.112 

C=0,907 

SET-Lt3 

N/-0.94 

L=0.000 

C=0.941 
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Table  D. 10  Data  Analysis  of  Failure  Set  SSlc 


- 1 

F.  Set 

Stgiitficaiice  Ltvcl  a 

0.0002U 

0.00050 

0.00100 

0.00250 

0.00500 

0.01000 

0.02500 

0.05000 

1 

2 

N7-0.54 

L=0.405 

C=0.943 

4 

N7-0.61 

L=0.330 

C=0.943 

5 

Y/0.012 

L=0.995 

C=0.9S3 

Y/0.011 

L=0.995 

C=0.9S4 

Y/0.009 

L=0.995 

C=0.9S5 

Y/0.007 

L=0.995 

C=0.987 

Y/0.006 

L=0.995 

C=0.988 

Y/0.005 

L=0.995 

C=0.990 

0 

N7-0.75 

L=0.194 

C=0.946 

14C 

V/0.032 

L=0.972 

C=0.939 

Y/0.02S 

L=0.972 

C=0.944 

Y/0.023 

L=0.972 

C=0.948 

Y/0.013 

L=0.972 

C=0.9.59 

Y/0.008 

L=0.972 

C=0.964 

Y/0.002 

1=0.972 

C=0.970 

N7-0.00 

L=0.972 

C=0.975 

17 

N7-0.3S 

L=0.556 

C=0.940 

27 

N7-0.17 

L=0.773 

C=0.940 

H 

Y/0.040 

L=0,991 

C=0.952 

Y/0.0364 

L=0.9911 

C=0.9557 

Y/0.024 

L=0.991 

C=0.9G7 

570. 0200 

L=0.9911 

C=0.9715 

Y/O.Olo 

L=0.991 

C=0.97G 

570.011 

L=0.991 

C=0.9S0 

sslc 

Two 

Identical  Sets  or  Set  Compared  with  Itself  L  =  1.0 

SS3 

^7-o.oo 

L=0.964 

C=0.96G 

N/-0.16 

L=0.799 

C=0.960 

Litt2 

N/-0.64 

L=0.310 

C=0.948 

Litt3 

N/-0.9G 

L=0.000 

C=0.961 
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Table  D.  1 1  Data  Analysis  of  Failure  Set  SS3 


F.  Set 

0.00025 

SET-1 

N/-0.95 

L=0.000 

C=0.954 

SET.2 

N/-0.57 

L=0.371 

C=0.943 

SET.4 

N/-0.64 

L=0.303 

C=0.943 

SET-5 

Y/0.006 

L=0.989 

C=0,9S3 

SET-6 

N/-0.77 

L=0.174 

C=0.946 

N/-0.00 

1=0.936 

C=0.940 

SET-17 

N/-0.42 

L=0.521 

C=0.940 

SET-SI  a 

Y/0.040 

L=0.992 

C=0.952 

N7-0.00 

L=0.964 

C=0.96G 

SET-SS4 

N7-0.04 

L=0.920 

C=0.960 

SET_Lt2 

N7-0.67 

L=0.274 

C=0.948 

SET-Lt3 

N7-0.96 

L=0.000 

C=0.961 

Table  D.12  Data  Analysis  of  Failure  Set  SS‘l 
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Table  D.13  Data  Analysis  of  Failure  Set  Litt2 
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Table  D.H  Data  Analysis  of  Failure  Set  Litt3 


F.  Data 


SET.l 


SET.2 


SET-4 


SET-5 


SET.6 


SET.14C 


SET.17 


0.00025 


N7-0.08 

L=0.867 

C=0.945 


N7-0.08 

L=0.848 

C=0.928 


N7-0.98 

L=0.000 

C=0.982 


N7-0.02 

L=0.909 

C=0.933 


N7-0.92 

L=0.000 

C=0.923 


0.00050  0.00100 


Significance  Level  q 


0.00250  0.00500 


0.01000  0.02500  I  0.05000 


.063 

Y/0.057 

Y/0.050 

Y/0.045 

Y/0.039 

Y/0.032 

Y/0.02G 

.996 

L=0.996 

L=0.996 

L=0.990 

L=0.996 

L=0.996 

L=0.996 

).933 

C=0.939 

C=0.946 

C=0.951 

C=0.957 

C=0.9C4 

C=0.970 

SET-SI  a 


SET-SI  c 


SET-SS3 


SET-SS4 


SET-Lt2 


N7-0.83 

L=0.097 

C=0.924 


N/-0.94 

L=0.000 

C=0.941 


N7-0.90 

L=0.000 

C=:0.9C1 


N7-0.96 

L=0.000 

C=0.961 


N/-0.95 

L=0.000 

C=0.953 


SET-Lt3 


Two  Identical  Sets  or  Set  Compared  with  Itself  L 


D-14 


APPENDIX  E.  Exact  and  Asymptotic  Percentage  Points  of  the  Test 

Statistic 

Table  E.l  Percentage  Points  of  L  =  when  p=2 


Failures 
per  sample 

Level  of  Significance  a 

0.100 

0.050 

0.025 

0.010 

0.005 

r=  5 

0.449752 

0.368224 

0.302557 

0.234197 

0.193293 

r=  6 

0.529323 

0  451446 

0.386168 

0.315083 

0.270573 

r=  7 

0.589488 

0.516492 

0.453664 

0.383167 

0.337681 

r=  8 

0.636320 

0.568307 

0.508641 

0.440245 

0.395162 

r=  9 

0.673746 

0.610380 

0.554012 

0.488355 

0.444380 

r=  10 

0.704265 

0.645142 

0.591966 

0.529252 

0.486724 

r=  11 

0.729615 

0.674304 

0.624117 

0.564338 

0.523397 

r=  12 

0.750998 

0.699097 

0.651667 

0.594711 

0.555387 

r=  13 

0.769267 

0.720420 

0.675515 

0.621226 

0.583491 

T-  H 

0.785056 

0.738947 

0.696349 

0.644554 

0.608347 

r=  15 

0.798822 

0.755189 

0.714698 

0.665224 

0.630470 

r=  20 

0.847698 

0.813374 

0.781060 

0.740910 

0.712234 

r=  25 

0.877481 

0.849270 

0.822471 

0.788849 

0.764602 

r=  30 

0.897547 

0.873605 

0.850742 

0.821874 

0.800924 

r=  35 

0.911900 

0.891182 

0.871259 

0.845990 

0.627569 

r=  40 

0.922823 

0.904472 

0.886824 

0.864365 

0.847940 

r=  45 

0.931300 

0.914870 

0.899034 

0.878829' 

0.864014 

r=  50 

0.938100 

0.923229 

0.908868 

0.890509 

0.877020 

r=  55 

0.943670 

0.930093 

0.916958 

0.900137 

0.887758 

r=  60 

0.948330 

0.935831 

0.923729 

0.908210 

0.896773 

r=:  65 

0.952274 

0.940699 

0.929480 

0.915076 

0.904449 

r—  70 

0.955658 

0.944880 

0.934425 

0.920988 

0.911063 

0.958595 

0.948511 

0.938722 

0.926130 

0.916822 

0.961107 

0.951693 

0.942490 

0.930644 

0.921880 

0.963438 

0.954505 

0.945822 

0.934638 

0.926359 

r=  90 

0.965458 

0.957007 

0.948789 

0.938197 

0.930352 

r=  95 

0.967266 

0.959249 

0.951448 

0.941389 

0.933935 

r=100 

0.968895 

0.961268 

0.953845 

0.944268 

0.937167 

r=105 

0.970369 

0.963097 

0.956016 

0.946877 

0.940098 

r=110 

0.971710 

0.964761 

0.957992 

0.949252 

0.942767 

r=115 

0.972935 

0.966281 

0.959799 

0.951425 

0.945209 

o 

CM 

II 

0.974058 

0.967676 

0.961456 

0.953419 

0.947451 

r=125 

0.975091 

0.968960 

0.962982 

0.955256 

0.949517 

r=130 

0.976046 

0.970145 

0.964392 

0.956953 

0.951427 

r=]35 

0.976930 

0.971244 

0.965698 

0.958527 

0.953197 

o 

IT 

0.954843 

0.959989 

0.966912 

0.959989 

0.954843 

r=145 

0.956377 

0.961352 

0.968043 

0.961352 

0.956377 

r=150 

0.957811 

0.962625 

0.969099 

0.962625 

0.957811 

E-1 


Table  E.2  Percentage  Points  of  L  =  A'^  when  p=^3 


Fathires 
per  sample 

Level  of  Significance  u 

0.100 

0.050 

0.025 

0.010 

0.005 

r=  5 

0.267091 

0.209072 

0.165154 

0.121904 

0.097222 

r=  6 

0.347988 

0.286615 

0.238030 

0.187729 

0.157509 

r=  7 

0.414579 

0.352800 

0.302399 

0.248465 

0.214986 

r=  8 

0.469791 

0.409111 

0.358512 

0.303058 

0.267820 

r=  9 

0.516029 

0.457190 

0.40730G 

0.351634 

0.315624 

r=  10 

0.555170 

0.498503 

0.449832 

0.394734 

0.358595 

r=  11 

0.588651 

0.534266 

0.487063 

0.433010 

0.397157 

r=  12 

0.617573 

0.565457 

0.519835 

0.467098 

0.431792 

r=  13 

0.642778 

0.592859 

0.548847 

0.497567 

0.462971 

1! 

0.664924 

0.617098 

0.574674 

0  .524914 

0.491123 

r=  15 

0.684524 

0.638674 

0.597791 

0  549.561 

0.516626 

=  20 

0.756144 

0.718456 

0.684247 

0.643088 

0.614437 

r=  25 

0.801400 

0.769596 

0.740426 

0.704924 

0.679931 

r=  30 

0.832536 

0.805089 

0.779744 

0.748663 

0.726621 

r=  35 

0.855252 

0.831139 

0.808765 

0.781180 

0.761515 

r=  40 

0.872551 

0.851062 

0.831051 

0.806281 

0.788555 

r=  45 

0.886162 

0.866788 

0.848697 

0.826235 

0.810112 

r=  50 

0.897149 

0.879515 

0.863012 

0.842472 

0.827694 

r=  55 

0.906203 

0.890025 

0.874856 

0.855940 

0.842304 

r=  60 

0.913794 

0.898850 

0.884818 

0.867290' 

0.854635 

r=  65 

0.920248 

0.906365 

0.893313 

0.876986 

0.865181 

r=  70 

0.925804 

0.912841 

0.900642 

0  885362 

0.874303 

r=  75 

0.930637 

0.918480 

0.907029 

0.892672 

0.882270 

r=  80 

0.934878 

0.923435 

0.912645 

0.899107 

0.889289 

r=  85 

0.938631 

0.927821 

0.917622 

0.904814 

0.895518 

r=  90 

0.941976 

0.931733 

0.922063 

0.909911 

0.901085 

r=  95 

0.944974 

0.935242 

0.926050 

0.914490 

0.906089 

o 

o 

II 

0.947678 

0.938409 

0.929648 

0.918626 

0.910611 

r=105 

0.950129 

0.941280 

0.932913 

0.922381 

0.914719 

r=110 

0.952360 

0.943896 

0.935889 

0.925805 

0.918465 

r=115 

0.954401 

0.946288 

0.938612 

0.928939 

0.921897 

r=120 

0.956274 

0.948485 

0.941113 

0.931820 

0.925051 

r=125 

0.957999 

0.950509 

0.943418 

0.934476 

0.927961 

r=130 

0.959593 

0.952381 

0.945550 

0.936933 

0.930653 

r=135 

0.961070 

0.954116 

0.947526 

0.939213 

0.933151 

r=140 

0.962444 

0.955729 

0.949365 

0.941333 

0.935476 

r=145 

0.963723 

0.957232 

0.951079 

0.943311 

0.937644 

r=150 

0.964919 

0.958637 

0.952681 

0.945160 

0.939672 

Table  E.3  I'ercentage  Points  of  L  —  wbeii  p=-4 


failures 
per  sample 

Level  of  Stgnijicaiici  a 

0.100 

0.050 

0.025 

0.010 

0.005 

r=  5 

0.163207 

0.122321 

0.092616 

0.064596 

0.049267 

r=  6 

0.236473 

0.189151 

0.153010 

0.116830 

0.095732 

r=  7 

0.300401 

0.249806 

0.209863 

0.168396 

0.143314 

r=  8 

0.356022 

0.304056 

0.262035 

0.217265 

0.189488 

r=  9 

0.404423 

0.352204 

0.309309 

0.262631 

0.233110 

r=  10 

0.446668 

0.395040 

0.351903 

0.304292 

0.273724 

r=  11 

0.483713 

0.433048 

0.390219 

0.342349 

0.311238 

r=  12 

0.516370 

0.460919 

0.424713 

0.377045 

0.345751 

r=  13 

0.545319 

0.49721C 

0.455828 

0.408675 

0.377457 

r=  14 

0.571123 

0.524427 

0.483974 

0.437543 

0.406581 

r=:  15 

0.594244 

0.548967 

0.509513 

0.463938 

0.433360 

r=  20 

0  680921 

0.642223 

0.607815 

0.567186 

0.539342 

r=  25 

0.737413 

0.703997 

0.673932 

0.637973 

0.613020 

r=  30 

0.777026 

0.747748 

0.721202 

0.689182 

0.666780 

r=  35 

0.806303 

0.780303 

0.756601 

0.727839 

0.707600 

II 

o 

0.828807 

0.805451 

0.784071 

0.758012 

0.739596 

r=  45 

0.846639 

0.82.5451 

0.805995 

0.782199 

0.765327 

r=  50 

0.861114 

0.641734 

0.823892 

0.802011 

0.786456 

r=  55 

0.87309C 

0.855244 

0.838775 

0.818533 

0.804111 

r=  60 

0.883178 

0.866633 

0.851344 

0.832517' 

0.819080 

r=  65 

0.891778 

0.876363 

0.862099 

0.844506 

0.831930 

r=  70 

0.899199 

0.884772 

0.871405 

0.854896 

0.843081 

r=  75 

0.905669 

0.892111 

0.879536 

0.863988 

0.852848 

r=  80 

0.911359 

0.898572 

0.886701 

0.872009 

0.801472 

r=  85 

0.916402 

0.904304 

0.893063 

0.879139 

0.809143 

r=  90 

0.920903 

0.909423 

0.898749 

0.885516 

0.870010 

r=  95 

0.924943 

0.914022 

0.903862 

0.891256 

0.882194 

r=100 

0.928592 

0.918178 

0.908463 

0.896448 

0.887790 

r=105 

0.931902 

0.921950 

0.912681 

0.901167 

0.892880 

r=110 

0.934919 

0.925390 

0.916511 

0.905475 

0.897528 

r=115 

0.937680 

0.928540 

0.920019 

0.909424 

0.901791 

r=120 

0  940217 

0.931434 

0.923244 

0.913056 

0.905713 

r=125 

0.942555 

0.934104 

0.926220 

0.916408 

0.909334 

r=130 

0.944717 

0.936573 

0.928973 

0.919511 

0.912687 

r=135 

0.946722 

0.938864 

0.931528 

0.922393 

0.915802 

r=140 

0.948587 

0.940996 

0.933907 

0.925075 

0.918702 

r=145 

0.950326 

0.942984 

0.936125 

0.927578 

0.921409 

r=150 

0.951951 

0.944842 

0.938199 

0.929920 

0.923941 

E-3 


Table  L.4  Percentage  Points  of  T  =  A  s  when  p=5 


Failures 
per  sample 

Level  of  Stgnxficaiici  o 

0.025 

0.010 

0.005 

r=  6 

0.103811 

0.128060 

0.101629 

0.076017 

0.061524 

r=:  7 

0.220897 

0.180198 

0.14892C 

0.117309 

0.098639 

r=  8 

0.273189 

0.229512 

0.195032 

0.159134 

0.137313 

r=  9 

0.320432 

0.275122 

0.238621 

0.199779 

0.175660 

r=  10 

0.362879 

0.316854 

0.279183 

0.23840C 

0.212663 

r=  11 

0.400973 

0.354853 

0.316617 

0.274657 

0.247814 

r=  12 

0.435198 

0.389399 

0.351028 

0.308440 

0.586766 

r=  13 

0.466021 

0.420820 

0.382614 

0.695443 

0.491269 

T-  14 

0.4938G4 

0.449441 

0.411610 

0.503296 

0.340773 

r=  15 

0.519099 

0.47.5566 

0.438254 

0.407376 

0.3C7715 

r=  20 

0.616001 

0.577404 

0.543581 

0.504181 

0.47748C 

r=  25 

0.681000 

0.646942 

0.616708 

-0.580990 

0.556462 

r=  30 

0.727395 

0.697127 

0.670026 

0.637715 

0.615329 

r=  35 

0.7G2100 

0.734949 

0.710492 

0.681142 

0.660680 

r=  40 

0.789012 

0.764436 

0.742200 

0.715385 

0,696602 

r=  45 

0.810477 

0.788053 

0.767692 

0.743047 

0.725723 

r=  50 

0.827992 

0.807385 

0.788623 

0.7G5S44 

0.749786 

It 

cn 

0.842552 

0.823497 

0.806109 

0.784947 

0.769994 

r=  CO 

0.854845 

0.837129 

0.820933 

0.801183 

0.787199 

r=  65 

0.865360 

0.848812 

0.833659 

0.815148. 

0.802020 

r=  70 

0.874458 

0.8.58934 

0.844700 

0.82728G 

0.814919 

r=:  75 

0.882405 

0.867788 

0.854369 

0.837932 

0.82G245 

r=  80 

0.889408 

0.875598 

0.862908 

0.847346 

0.836269 

r=  85 

0.89.5624 

0.882538 

0.870502 

0.855728 

0.845203 

It 

o 

0.901179 

0.888745 

0.877300 

0.863240 

0.8.53214 

r=  95 

0.906173 

0.894330 

0.883421 

0.870009 

0.860438 

o 

o 

IT 

0.910687 

0.899382 

0.8889G1 

0,870141 

0.866986 

r=105 

0.914787 

0.903973 

0.893999 

0.881721 

0.872948 

r=110 

0.918527 

0.908164 

0.898601 

0.88G820 

0.878400 

r=115 

0.921953 

0.912004 

0.902819 

0.891499 

0.883403 

r=120 

0.925103 

0.915537 

0.906701 

0.895807 

0,888011 

r=125 

0.928008 

0.918797 

0.910285 

0.899786 

0.892269 

r=130 

0.930697 

0.921814 

0.913604 

0.903472 

0.896216 

r=135 

0.933192 

0.924616 

0.916687 

0.906897 

0.899884 

r=140 

0.935514 

0.927224 

0.919557 

0.910088 

0.903302 

r=145 

0.937679 

0.929658 

0.922236 

0.913067 

0.90G494 

r=150 

0.939704 

0.931934 

0.924742 

0.915855 

0.909483 

E-^ 


Table  L.o  Percentage  Points  o{  L  —  An  witli  unequal  sample  sizes 
(q  =  .01.  .05,p=2) 


Q  = 

.01 

Total  Number  of  Failures  R 

^’1 

10 

15 

20 

25 

30 

.50 

.50 

0.234197 

0.412950 

0.529252 

0.608405 

0.665224 

.45 

.55 

0.233263 

0.412267 

0.528772 

0.608058 

0.664963 

.40 

.60 

0.230377 

0.410141 

0.527275 

0.606973 

0.664148 

.35 

.65 

0.225282 

0.406314 

0.524565 

0.605006 

0.662670 

.30 

.70 

0.217567 

0.400287 

0.520250 

0.601861 

0.660302 

.25 

.75 

0.391187 

0.513586 

0.596967 

0.656006 

.20 

.80 

0.377726 

0.503170 

0.589184 

0.650688 

.15 

.85 

0.486527 

0.576075 

0.640521 

a  = 

.01 

Total  Number  of  Fai 

Inrts  R 

^‘1 

40 

CO 

80 

100 

120 

.50 

..50 

0.621874 

0.864365 

0.890509 

0.908210 

.45 

,55 

0.740749 

0.821796 

0.864320 

0.890479 

0.908189 

.40 

.60 

0.821552 

0.864176 

0.890385 

0.908123 

.35 

.65 

0.739332 

0.821108 

0.863916 

0.890215 

0.908002 

.30 

.70 

0.737808 

0.820398 

0.863499 

0.889941 

0.907809 

.25 

.75 

0.735578 

0.819285 

0.862847 

0.889513 

0.907508 

.20 

o 

CO 

0.731893 

0.817493 

0.861790 

0.888825 

0.907022 

.15 

.85 

0.725477 

0.814358 

0.887621 

0.906174 

Q  = 

.05 

Total  Number  of  Failures  R 

■91 

10 

15 

20 

25 

30 

.50 

.50 

0.368224 

0,.543806 

0.645142 

0.710145 

0.755189 

.45 

.55 

0.367196 

0.543173 

0.644733 

0.709863 

0.754983 

.40 

.60 

0.364009 

0.541197 

0.643453 

0.708979 

0.754339 

.35 

.65 

0.358338 

0.537626 

0.641132 

0.707373 

0,753169 

.30 

.70 

0.349618 

0.531955 

0.637418 

0.704798 

0.751291 

.25 

.75 

0.523260 

0.631635 

0.700771 

0.748349 

.20 

.80 

0.509963 

0.622454 

0.694305 

0.743607 

.15 

.85 

0.607198 

0.683191 

0.735355 

Q  = 

Total  Number  of  Failures  R 

^'2 

40 

60 

80 

100 

120 

.50 

.50 

0.813374 

0.873605 

0.904472 

0.923229 

0.935831 

.45 

.55 

0.813252 

0.873548 

0.904439 

0.923207 

0.935816 

.40 

.60 

0.812868 

0.873368 

0.904335 

0.923140 

0.935769 

.35 

.65 

0.812172 

0.873042 

0.904147 

0.923018 

0.935683 

.30 

.70 

0.811054 

0.872518 

0.903845 

0.922822 

0.935546 

.25 

.75 

0.809301 

0.871698 

0.903372 

0.922515 

0.935331 

.20 

.80 

0.806470 

0.870373 

0,902610 

0.922021 

0.934985 

.15 

.85 

0.801506 

0.868049 

0.901274 

0.921156 

0.934380 

E-5 


Table  E.6  Percentage  Points  of  L  =  witli  unequal  saini)le  sizes 
(a  =  .01,  .05,;- =3) 


Q 

=  . 

01 

Total  Number  of  Fatlurts  H 

^*1 

kn 

h 

10 

15 

20 

25 

30 

.33 

.33 

.34 

0.018296 

0.121895 

0.228876 

0.319888 

0.394727 

.30 

.30 

.40 

0.017713 

0.121021 

0.228008 

0.319113 

0.394061 

.30 

.35 

.35 

0.018151 

0.121678 

0.228652 

0.319684 

0.394549 

.25 

.25 

.50 

0.116438 

0.223478 

0.315090 

0.390617 

.25 

.30 

.45 

0.119065 

0.226019 

0.317317 

0.392509 

.25 

.35 

.40 

0.120352 

0.227225 

0.3183.55 

0.393380 

.20 

.20 

.60 

0.107657 

0.214517 

0.307031 

0.383685 

.20 

.30 

.50 

0.116144 

0.222636 

0.314076 

0  389622 

0 

=  .01 

Total  Number- of  Failures  R 

^'1 

1'2  i‘3 

40 

50 

60 

70 

80 

.33 

.33 

.34 

0.507002 

0.585586 

0.643085 

0.086799 

0.721083 

.30 

.30 

.40 

0.506519 

0.58.5229 

0.642813 

0.686586 

0.720912 

.30 

.35 

.35 

0.506871 

0.585488 

0.643011 

0.686741 

0.721036 

.25 

.25 

.50 

0.504038 

0.583401 

0.641424 

0.685498 

0.720040 

.25 

.30 

.45 

0.505389 

0.584391 

0.642174 

0.680085 

0.720510 

.25 

.35 

.40 

0.506004 

0.584840 

0,042514 

0.686349 

0.720721 

.20 

.20 

.60 

0.499028 

0.579710 

0.638619 

0.683305 

0.718282 

.20 

.30 

.50 

0.503225 

0.582767 

0.640926 

0.085101 

0.719717 

Q 

=  .05 

Total  Number  of  Failures  R 

ki 

A*  2  k 

3 

10 

15 

20 

30 

.34 

0.057163 

0.209061 

0,331908 

0.425966 

0.498*496 

.40 

0.056142 

0.207997 

0.330967 

0.425188 

0.497862 

.30 

.35 

.35 

0.056926 

0.208798 

0.331664 

0.425760 

0.498327 

.25 

.25 

,50 

0.202384 

0.326053 

0,421151 

0.494584 

.25 

.30 

.45 

0.205611 

0.328806 

0.423383 

0.496382 

.25 

.35 

.40 

0.207191 

0.330107 

0.424419 

0.497209 

.20 

,20 

.60 

0.191514 

0.316255 

0.413024 

0.487961 

.20 

,30 

.50 

0.202037 

0.325075 

0,420091 

0.493610 

Q 

=  .05 

Total  Number  of  Failures  R 

A*i 

k‘2  it 

3 

40 

50 

60 

80 

.33 

.33 

.34 

0,601258 

0.669779 

0.718453 

0.754727 

0.782772 

.30 

.30 

.40 

0.600828 

0.669472 

0.718225 

0.754551 

0.782632 

.30 

.35 

.35 

0.601142 

0.669695 

0,718391 

0.754679 

0.782734 

.25 

.25 

.50 

0.598613 

0.667900 

0.717059 

0.753654 

0.781922 

.25 

.30 

.45 

0.599818 

0.717688 

0,754138 

0.782304 

.25 

.35 

.40 

0.600366 

0.717973 

0.754355 

0.782476 

.20 

.20 

.60 

0.594132 

0.780489 

.20 

.30 

.50 

0.597876 

0.716038 

0.753324 

0.781657 

Talile  E.7  Comparison  of  Exact  and  Asymptotic  Values  of  the  Percentage  Points 

for  L  =  Aft  and  a  =  0.01 


Failures 

p=5 

p^3 

P=4 

per 

Exact 

First 

First 

Exact 

First 

First 

Exact 

First 

First 

SavijiU 

Using 

2  terms 

term 

Using 

2  terms 

term 

Using 

2  terms 

term 

(r) 

(G) 

of (19) 

of (19) 

(6) 

of  (19) 

of  (19) 

(6) 

of  (19) 

of (19) 

5 

0.234197 

0.232728 

0.231253 

0.121904 

0.113431 

0.108148 

0.0G459G 

0.050114 

0.044613 

G 

0.315083 

0.314095 

0.312921 

0.187729 

0.180706 

0.175512 

0.116830 

0.102762 

0.095544 

7 

0.383167 

0.382519 

0.381605 

0.248465 

0.243165 

0.238549 

0.168396 

0.156777 

0.149340 

8 

0.440245 

0,439814 

0.439103 

0.303058 

0.299160 

0.295212 

0.217265 

0,208152 

0.201178 

9 

0.4SS355 

0.4880C2 

0.487503 

0.351634 

0.348767 

0.345437 

0.262631 

0.255590 

0.249319 

10 

0.529252 

0.529047 

0.528601 

0.394734 

0.392605 

0.389805 

0.304292 

0.298853 

0.293321 

11 

0.5G4338 

0.564191 

0.563832 

0.433010 

0.431408 

0.429048 

0.342349 

0.338121 

0.333282 

12 

0.594711 

0.594603 

0.594310 

0.467098 

0.465873 

0.463876 

0.377045 

0.373728 

0.369507 

13 

0.621226 

0.621146 

0.620904 

0.497567 

0.496618 

0.494918 

0.408675 

0.406046 

0.402362 

14 

0.644554 

0.644493 

0.644292 

0.524914 

0.524168 

0.522713 

0.437543 

0. 13.5438 

0.432216 

15 

0  665224 

0.665176 

0.665007 

0.549561 

0.548968 

0.547715 

0.463938 

0.462236 

0.459409 

20 

0.740910 

0.740894 

0.740813 

0.643088 

0.642867 

0.642222 

0.567186 

0.566514 

0.564964 

25 

0,788849 

0.788842 

0.788798 

0.704924 

0.704823 

0.704452 

0.637973 

0.637658 

0.636731 

30 

0.821874 

0.821871 

0.821844 

0.748663 

0.748611 

0.748379 

0.689182 

0,689016 

0.688421 

35 

0.845990 

0.845988 

0.845970 

0.781180 

0.781150 

0.780996 

0.7278396 

0.727743 

0.727340 

40 

0.864365 

0.864364 

0.864352 

0.806281 

0.806263 

0.806155 

'  0.758012 

0.757952 

0.757667 

45 

0.878829 

0.878829 

0.878820 

0.826235 

0.826223 

0.826145 

0.782199 

0.782160 

0.781951 

50 

0.890509 

0.890509 

0.890503 

0.842472 

0.842464 

0.842405 

0.802011 

0.801985 

0.801827 

55 

0.900137 

0.900137 

0.900132 

0.855940 

0.855934 

0.855889 

0.818533 

0.818514 

0.818392 

GO 

0,908210 

0.908210 

0.908200 

0.867290 

0.867286 

0.867251 

0.832517 

0.832.504 

0.832407 

65 

0.915076 

0.915076 

0.915073 

0.876986 

0.876983 

0.876955 

0.844506 

0.844496 

0.844419 

70 

0.920988 

0.920987 

0.920985 

0.885362 

0.885360 

0.885337 

0.854896 

0.854889 

0.854826 

75 

0.926130 

0,926130 

0.926128 

0.892672 

0.892671 

0.892652 

0.863988 

0.8G39S2 

0,863930 

80 

0.930644 

0.930644 

0.930642 

0.899107 

0.899106 

0.899090 

0.872009 

0.872005 

0.871961 

85 

0.934638 

0.934638 

0.934636 

0.904814 

0.904813 

0.904800 

0.879139 

0.879135 

0.879098 

90 

0.93S197 

0.938197 

0.938196 

0.909911 

0.909910 

0.909899 

0,885516 

0.885513 

0.8S5482 

95 

0.941389 

0.941389 

0.941388 

0.914490 

0.914489 

•0.9144S0 

0.891256 

0.891253 

0.891227 

100 

0.944268 

0.944268 

0.944267 

0.918626 

0.918625 

0.918617 

0.896448 

0.896446 

0.896423 

105 

0.946877 

0.946877 

0.946876 

0.922381 

0.922380 

0.922373 

0.901167 

0.901165 

0.901145 

no 

0.949252 

0.949252 

0.949252 

0.925805 

0.925804 

0.925798 

0.905475 

0.905474 

0.905456 

115 

0.951425 

0.951425 

0.951424 

0.928939 

0.928939 

0.928933 

0.909424 

0.909422 

0.909407 

120 

0.953419 

0.953419 

0.953418 

0.931820 

0.931819 

0.931815 

0.913056 

0,913055 

0.913041 

125 

0.955256 

0.955256 

0.955255 

0.934476 

0.934476 

0.934471 

0.916408 

0.916407 

0.916395 

130 

0.956953 

0  956953 

0.956953 

0.936933 

0.936933 

0.936929 

0.919511 

0.919511 

0.919500 

135 

0.958527 

0.958527 

0.958526 

0.939213 

0.939212 

0.939209 

0.922393 

0.922392 

0.922382 

140 

0.959989 

0.959989 

0.959989 

0.941333 

0.941333 

0.941330 

0.925075 

0.925075 

0.925066 

E-7 


lable  E  8  Comparison  of  Exact  and  Asymptotic  \’alues  of  tlie  Percentage  Points 

for  L  =  Aft  and  a  =  0.05 


Failures 

p=2 

II 

P-4 

per 

Exact 

First 

First 

Exact 

First 

First 

Exact 

First 

First 

Sample 

Using 

2  terms 

term 

Using 

2  terms 

term 

Using 

2  terms 

term 

(r-) 

(6) 

of  (19) 

of (19) 

(6) 

of  (19) 

of (19) 

(6) 

of (19) 

of (19) 

5 

0.368224 

0.367279 

0  365570 

0.209072 

0.200361 

0.192507 

0.122321 

0.103594 

09337113 

C 

0.451446 

0.450909 

0.449732 

0.286615 

0.280641 

0.274142 

0.189151 

0.174706 

16413844 

" 

0.516492 

0.516177 

0.515346 

0.352800 

0.348796 

0.343631 

0.249806 

0.239354 

22987540 

8 

0.568307 

0.568113 

0.567511 

0.409111 

0.406393 

0.402313 

0.304056 

0.296553 

28845278 

9 

0.610380 

0.610256 

0.609807 

0.457190 

0.455303 

0.452062 

0.352264 

0.346825 

34001619 

10 

0.645142 

0.645059 

0.644717 

0.498503 

0.497161 

0.494560 

0.395040 

0.391036 

38533321 

11 

0.674304 

0.674247 

0  673980 

0.534266 

0.533288 

0.531178 

0.433048 

0.430050 

42526382 

12 

0.699097 

0.699056 

0.698844 

0.565457 

0.564729 

'0‘.562998 

0.466919 

0.464637 

46059907 

13 

0.720420 

0.720391 

0.720220 

0.592859 

0.592307 

0.590872 

0.497216 

0.495451 

49202562 

14 

0.738947 

0.738925 

0.738786 

0,617098 

0.616671 

0.615470 

0.524427 

0.523042 

52011616 

15 

0.755189 

0.755172 

0.755057 

0.638674 

0.638339 

0.637324 

0.548967 

0.547866 

54535109 

20 

0.813374 

0.813369 

0.813317 

0.718456 

0.718336 

0.717847 

0.642223 

0.641811 

64052864 

25 

0.849270 

0.849268 

0.849241 

0,769596 

0.769543 

0.769272 

0,703997 

0.703809 

70307431 

30 

0.873605 

0.873604 

0.873588 

0,805089 

0.805062 

0.804897 

0.747748 

0.747650 

74719221 

35 

0.891182 

0.891182 

0.891172 

0,831139 

0.831124 

0.831016 

0.7803036 

0.780247 

77994340 

40 

0.904472 

0.904472 

0.904465 

0,851062 

0.851053 

0.850979 

'  0.805451 

0.805416 

80520467 

Ab 

0.914870 

0.914870 

0.914865 

0.866788 

0.866782 

0.866729 

0.825451 

0.825429 

S2527551 

50 

0.923229 

0.923229 

0.923225 

0.879515 

0.879511 

0.879471 

0.841734 

0.841718 

84160327 

55 

0.930093 

0.930093 

0.930090 

0.890025 

0.890022 

0.889992 

0.855244 

0.855233 

85514592 

60 

0.935831 

0.935831 

0.935829 

0.898850 

0.898848 

0.898824 

0.866633 

0.866625 

86655607 

65 

0.940699 

0.940699 

0.940697 

0.906365 

0.906363 

0.906345 

0.876363 

0.S7G357 

87630219 

70 

0.944880 

0.944880 

0.944879 

0.912841 

0.912840 

0.912825 

0.884772 

0.884767 

88472326 

75 

0.94851  1 

0.948511 

0.948510 

0.918480 

0.918479 

0.9184G7 

0.892111 

0.892107 

89207130 

80 

0.951693 

0.951693 

0.951692 

0.923435 

0.923434 

0.923424 

0.898572 

0.898569 

89853961 

85 

0.95 1505 

0.954505 

0.954504 

0.927821 

0.927821 

0.927812 

0.904304 

0.904302 

90427698 

90 

0.957007 

0.957007 

0.957007 

0.931733 

0.931732 

9.931725 

0.909423 

0.909421 

90939982 

95 

0.959249 

0.959249 

0.959248 

0.935242 

0.935242 

0.935236 

0.914022 

0.914021 

91400227 

100 

0.961268 

0.961268 

0.961268 

0.938409 

0.938408 

0.938403 

0,918178 

0.918176 

91816023 

105 

0.963097 

0.963097 

0.963097 

0.941280 

0.941280 

0.941275 

0.921950 

0.921949 

0.921935 

110 

0.964761 

0.964761 

0.964761 

0.943896 

0.943895 

0.943891 

0.925390 

0.925389 

0.925377 

115 

0.966281 

0.»66281 

0.966281 

0.946288 

0.946288 

0.946285 

0.928540 

0.928539 

0.928528 

120 

0.967676 

0.967676 

0.967676 

0.948485 

0.948485 

0,948482 

0.931434 

0.931434 

0.931424 

125 

0.968960 

0.968960 

0.968959 

0.950509 

0.950509 

0.950507 

0.934104 

0.934103 

0.934095 

130 

0.970145 

0.970145 

0.970145 

0.952381 

0.952381 

0.952378 

0.936573 

0.936573 

0.936565 

1 35 

0.971244 

0.971244 

0.971244 

0.954116 

0.954116 

0.954113 

0.938864 

0.938864 

0.938857 

140 

0.959989 

0.972264 

0.972264 

0.955729 

0.955729 

0.955727 

0.940996 

0.940995 

0.940989 

E-8 
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